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INTRODUCTION 


Development  of  the  Problem 

Today's  health  care  environment  is  strongly  influenced  by  six  broad 
processes:  technology,  rising  consumer  expectations,  changing  morbidity, 
economics,  federal  intervention,  and  provider  accountabil ity J  In  1973 
Congress  passed  Public  Law  92-603,  the  Professional  Standards  Review  Organ¬ 
ization  Bill  (PSRO).  This  bill  was  an  answer  to  the  government's  increasing 
interest  in  the  quality  of  health  services  purchased  through  Medicare  and 
Medicaid.  Whether  the  law  has  served  its  purpose  remains  to  be  seen  as  not 
all  states  have  review  bodies.  The  Reagan  administration  proposes  to  repeal 
the  PSRO  statute  by  the  end  of  fiscal  year  1983.  This  bill  did  stimulate 
the  Joint  Commission  on  Accreditation  of  Hospitals  (JCAH)  to  include  profes¬ 
sional  review  in  its  requirements  for  quality  assurance  (QA).  This  require¬ 
ment  was  published  in  the  JCAH's  Accreditation  Manual  for  Hospitals  in 
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1974.  The  professional  review  became  the  Professional  Evaluation  Program 
or  PEP.  It  was  a  process  oriented,  retrospective  audit  of  the  medical 
record  to  evaluate  patient  care.  The  number  of  required  audits  was  based 
upon  the  hospital's  total  admissions  per  year.  This  requirement  was  dropped 
in  1978  in  favor  of  allowing  hospitals  to  do  as  many  audits  as  they  believed 
necessary.  Problems  with  the  audit,  as  a  sole  evaluator  of  quality  assur¬ 
ance,  were  high  costs  and  resistance  by  physicans  and  nurses  to  "cook  book" 
review.  Farrington,  et  al . ,  stated  that  the  process  had  become  a  game  of 
fulfilling  requirements  in  a  documentable,  quantifiable  format  to  satisfy 
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others.  Thus,  in  1980,  the  JCAH  published  new  standards  for  QA  which 
emphasized  quality  and  flexibility.  The  standards  became  effective  on  1 
January  1981.  The  new  standards  have  been  written  with  a  strong  emphasis  on 
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experimentation  and  flexibility  by  individual  hospitals.  No  longer  is  a 
single  formula  or  process  for  all  hospitals  advocated  by  the  JCAH.4  The  QA 
program  is  to  have  a  broad  range  of  coordinated  activities  to  ensure  the 
quality  of  care  delivered  meets  acceptable,  professional  standards.  The 
1981  Accreditation  Manual  for  Hospitals  defines  QA  as:  "...  a  well  de¬ 
fined,  organized  program  designed  to  enhance  patient  care  through  the  ongo¬ 
ing  objective  assessment  of  the  important  aspects  of  patient  care  and  the 
correction  of  identified  problems". ^ 

The  basic  mechanism  of  the  QA  program  lies  in  the  essential  components. 
These  are:  1)  identification  of  important  or  potential  problems  or  related 
concerns  in  the  care  of  patients;  2)  objective  assessment  of  the  cause  and 
scope  of  problems  or  concerns,  including  the  determination  of  priorities  for 
both  investigation  and  resolution  of  problems;  3)  implementation  of  deci¬ 
sions  or  actions  designed  to  eliminate  problems  insofar  as  possible;  4) 
monitoring  activities  designed  to  assure  that  the  desired  results  have  been 
achieved  or  obtained;  5)  documentation  that  reasonably  substantiates  the 
effectiveness  of  the  overall  program  to  enhance  patient  care  and  assure 
sound  cl  inical  practice. 

Simply  stated,  a  hospital  must  identify  problems,  assess  the  causes, 
prioritize  the  problems  for  resolution,  implement  actions,  monitor  the 
actions,  and  evaluate  their  results  and  the  program's  effectiveness. 

Hospitals  must  not  jump  into  the  new  QA  program  without  careful  plan¬ 
ning.  First,  hospital  goals  must  be  addressed  and  the  current  QA  program 
assessed.  Only  then,  can  a  hospital  implement  a  new  QA  program  or  modify  an 
existing  one.  The  QA  Guide,  published  by  the  JCAH,  contains  specific  guide¬ 
lines  to  perform  this  task. 

The  QA  program  begins  with  the  identification  of  problems,  real  and 
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potential,  related  to  patient  care.  The  importance  of  this  step  must  not  be 
underestimated.  Failure  to  identify  meaningful  problems  affecting  health 
care  delivery  will  result  in  the  QA  program  being  only  an  exercise,  much 
like  performing  a  required  number  of  audits.  Hence,  the  problems  must  be 
identified  before  they  can  be  verified. 

Traditionally,  there  are  many  sources  for  problem  identification  and 
varied  objective  and  subjective  methods  for  verification.  Sources  such  as 
medical  records,  hospital  reports,  or  patient  complaints  are  compared  to  an 
established  criteria  or  norm  and  conclusions  are  drawn.  The  criteria  can  be 
internal,  developed  by  staff;  or  external,  developed  by  an  outside  agency 
like  JCAH.  They  can  be  either  explicit  or  implicit.  A  national  fire  code 
can  require  automatically  closing  fire  doors,  an  easily  evaluated  criteria. 

A  professional  standards  review  organization  can  require  patients  to  be 
hospitalized  only  as  long  as  medically  necessary,  a  very  subjective  criteria. 
Ihus,  a  hospital  must  not  limit  problem  identification  to  a  single  source, 
nor  to  only  external  or  internal  evaluations  made  by  comparison  to  objective 
or  subjective  criteria.  A  hospital  must  use  meaningful  sources  to  identify 
strengths  and  weaknesses  in  its  health  care  delivery. 

Historically,  the  military  hospital  sought  compliance  with  external 
inspecting  requirements  as  a  quality  care  measurement  rather  than  internal 
problem  identification.  Problems  identified  by  hospital  staff,  committees, 
or  patients  usually  are  resolved  as  quickly  as  possible  so  as  not  to  "display 
dirty  laundry."  The  Joint  Commission  on  the  Accreditation  of  Hospitals' 
accreditation  survey  and  the  US  Army  Health  Services  Command's  Annual  General 
Inspection  have  been  used  as  problem  identifiers.  The  validity  of  these 
problems  relative  to  patient  health  care  delivery  has  not  been  evaluated; 
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hospital  s  purpose  was  to  comply  with  the  requirement.  Two  military  hospital 
problem  identification  process  are  the  Health  Care  Consumer  Committee  and 
the  Health  Services  Command  Outpatient  Satisfaction  Survey.  The  Health  Care 
Consumer  Committee  is  composed  of  the  military  hospital  commander,  his 
senior  physician,  and  several  high  ranking  military  community  officials. 

This  committee  is  required  at  each  US  Army  hospital.  Its  purpose  is  to 
maintain  a  dialog  between  the  hospital  and  the  community.  A  review  of  the 
minutes  at  Lyster  Hospital  indicated  that  very  few  problems  were  being 
discussed  and  the  meeting  frequency  was  reduced  because  of  so  little  activity 
The  Health  Services  Command  Outpatient  Satisfaction  Survey  is  a  written 
questionnaire  designed  to  obtain  the  outpatient's  response  to  certain  ques¬ 
tions.  The  survey  is  not  individualized  to  each  military  facility  and  the 


results  are  not  computed  at  the  military  hospital.  The  hospital  perception 


is  that  the  results  are  noc  used  as  a  diagnostic  tool,  but  rather  to  grade 
hospitals  against  each  other. 

The  new  direction  of  the  JCAH  QA  program  offers  the  military  hospital 
an  opportunity  to  address  problems  as  it  perceives  them  and  not  rely  entirely 
upon  external  bodies  or  centrally  direct  committees  and  surveys.  Identi¬ 
fying  these  problems  will  be  an  important  step  in  the  new  QA  program.  Any 
method  used  to  identify  the  problems  should  be  personalized  to  the  hospital 
and  community  and  not  be  limited  to  traditional  means  or  complaints.  This 
is  important  because  the  military  hospital,  much  like  a  health  maintenance 
organization,  has  a  captured  population  receiving  all  its  health  care  from 
one  source.  The  military  hospital  should  use  an  approach  which  offers  both 
providers  and  patients  the  opportunity  to  present  problems  to  the  hospital 
QA  mechanism  for  action. 


The  problem  is  to  develop  a  method  of  assessing  military  hospital 
health  care  delivery  performance,  as  perceived  by  patients  and  providers, 
for  use  in  the  QA  Program. 

T'e  method  should  be  applicable  to  any  military  health  care  facility. 

That  is,  it  should  not  be  so  specific  for  the  Lyster  US  Army  Community 
Hospital  (Lyster),  Fort  Rucker,  Alabama,  area  that  it  cannot  be  used  at  the 
Brooke  Army  Medical  Center  or  Darnall  Army  Hospital. 

Although  military  facilities  operate  in  different  areas  of  the  United 
States,  Panama,  and  Europe,  their  health  care  delivery  responsibilities  are 
similar.  These  hospitals  have  the  primary  mission  of  delivering  complete 
health  care  services  to  their  supported  population.  This  population  consists 
of  active  duty  personnel,  active  duty  dependents,  retired  military  personnel, 
and  the  dependents  of  retired  and  deceased  personnel.  The  active  duty 
personnel  are  usually  a  young  health  group  between  the  ages  of  18  and  50. 

Their  dependents  range  from  newborns  to  fifty.  Retirees  and  their  dependents 
are  an  older  group,  usually  forty  years  of  age  and  older,  with  their  children, 
usually  teenagers.  Thus,  the  populations  supported  by  US  Army  facilities 
are  similar  in  make-up  with  some  post-to-post  differences  based  upon  the 
post's  mission,  surrounding  civilian  city  size,  weather,  and  cost  of  living. 
Regardless  of  location  the  complete  health  care  delivery  mission  of  all  US 
Army  facilities  remains  virtually  the  same. 

Medical  specialty  differences  in  military  hospitals,  staff,  and  beneficiary 
population  supported  by  these  hospitals  should  be  taken  into  consideration. 

The  method  should  fit  into  the  Joint  Commission's  QA  program  guidelines. 

The  basis  for  this  is  the  Surgeons  General  of  the  Army,  Navy,  and  Air  Force 
require  JCAH  accreditation  of  their  military  hospitals. 

It  should  be  noted  that  US  Army  hospitals  do  not  provide  skilled  nursing 
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care  nor  long-term  hospital  care.  Also,  if  a  certain  specialty  or  subspecialty 
is  not  available  at  the  US  Army  hospital,  the  beneficiary  may  elect  to  use 
a  civilian  physician  for  that  care  and  continue  to  use  the  military  facility 
for  all  other  care.  The  US  Army  does  not  operate  specialty  hospitals,  which 
provide  only  one  type  of  care  or  treat  one  specific  person,  such  as  a  psychi¬ 
atric  hospital  or  an  outpatient  surgery  center.  The  complete  health  care 
mission  remains. 

The  data  gathered  from  the  research  must  be  useful  to  Lyster's  QA 
program.  Lyster's  QA  committee  should  be  able  to  use  the  data  for  a  valid 
appraisal  of  the  hospital's  performance. 

The  project  will  be  to  develop  prioritized  problem  lists  from  the  data 
gathered  during  the  methodology  research.  The  methodology  will  use  one 
questionnaire  to  obtain  basic  data  about  hospital  problems  and  another 
questionnaire  to  prioritize  the  most  identified  problems.  The  problem  lists 
may  be  used  by  the  hospital's  QA  committee  to  assess  and  prioritize  hospital 
problems.  QA  committee  actions  to  correct  identified  problems  and  evaluate 
the  effectiveness  of  those  actions  will  assist  in  evaluation  of  hospital 
performance.  The  important  step  is  to  identify  the  problems. 

Limitations  and  Assumptions 

It  was  recognized  that  some  individuals  would  not  respond  to  the  question¬ 
naire  because  of  apathy  or  fear  of  reprisal.  Some  apathy  had  been  fostered 
by  the  hospital's  previous  lack  of  response  to  patient  needs.  The  hospital 
had  the  nickname  "Battlestar  Lyster"  and  "Fort  Lyster"  because  of  the  diffi¬ 
culty  patients  experienced  in  gaining  entry  into  the  health  care  system.  A 
definite  "we  versus  they"  attitude  existed  between  the  patients  and  staff. 
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The  staff  held  a  similar  attitude  toward  the  hospital's  headquarters.  The 
headquarters  was  perceived  as  an  inanimate  object  that  made  decisions  without 
regard  to  staff  input.  This  situation  is  changing  with  the  assignment  of  a 
new  hospital  commander,  but  change  is  a  slow  process. 

Some  beneficiaries  and  staff  members  believe  that  reprisals  will  be 
taken  against  those  who  criticize  the  hospital.  Beneficiaries  believe  they 
will  receive  a  reduced  level  of  care  or  be  denied  access  to  care.  Lyster's 
small  staff  lends  itself  to  the  presumption  that  anyone  who  makes  trouble 
will  become  known.  Likewise,  some  staff  members  believe  their  military 
careers  will  be  jeopardized  if  they  criticize  the  hospital.  This  fear  is 
substantiated  by  the  Study  on  Military  Professionalism  prepared  by  students 
at  the  US  Army  War  College.6  The  study  found  that  officers  subordinated 
their  individual  ethics  and  beliefs  in  fear  of  impediment  of  their  career 
advancement. 

The  population  considered  for  the  study  is  limited  by  the  availability 
of  organized  population  directories.  For  active  duty  soldiers,  the  study  is 
limited  to  those  permanently  assigned  at  Fort  Rucker.  Active  duty  USAR  or 
USANG  component  personnel  are  not  considered  because  they  are  not  included 
on  the  Fort  Rucker  Standard  Installation/Division  Personnel  System  alpha¬ 
betical  roster.  However,  they  are  authorized  care  on  a  limited  basis. 

The  active  duty  dependent  population  is  limited  to  those  residing  on 
the  post.  This  group  is  the  only  large  dependent  group  already  available  on 
a  listing.  Other  listings  are  available  from  wives  clubs  or  religious 
organizations  but  these  would  not  give  an  unbiased  cross  section  of  the 
dependent  population.  During  the  period,  October  1979  to  November  1980, 
twenty  three  percent,  of  the  active  duty  dependent  population  resided  on 


The  retirees  are  limited  to  those  within  a  forty  mile  radius  of  Fort 
Rucker  for  two  reasons:  First,  the  Fort  Rucker  Retirement  Services 
Center  maintains  two  mailing  lists  of  retired  personnel.  One  is  an  alpha¬ 
betical  listing  of  all  retirees  in  the  Fort  Rucker  area  of  responsibility. 
This  area  includes  the  southern  half  of  Mississippi  and  Alabama,  and  the 
Florida  panhandle  (Appendix  B).  To  choose  at  random  from  this  list  would 
select  retirees  who  do  not  usually  use  Lyster  Hospital  because  of  distance. 

A  second  list  is  available  of  all  retirees  within  a  forty-mile  radius  of 
Fort  Rucker.  This  list  more  accurately  reflects  the  '-etirees  who  use  Lyster 
Hospital;  and  thus,  was  the  one  used  to  randomly  select  retirees. 

The  survey  was  limited  to  voluntary  participation.  No  effort  was  made 
to  use  military  or  supervisory  authority  to  coerce  patient  or  staff  partici¬ 
pation  in  the  survey  process.  In  the  opinion  of  the  surveyor,  this  type  of 
coersion  will  not  obtain  a  person's  true  perceptions  about  an  operation,  but 
will  slant  the  data  in  favor  of  what  the  person  believes  the  surveyor  wants. 
Voluntary  participation  limits  the  survey  to  those  who  have  strong  positive 
or  negative  interests  in  the  hospital  operation.  Individuals  whose  level  of 
interest  was  low,  or  who  had  no  interest,  would  not  be  required  to  parti¬ 
cipate. 

Because  the  initial  questionnaire  was  open  ended,  in  that  it  made  no 
suggestions  about  areas  upon  which  to  comment,  the  responses  were  not  uniform 
and  required  some  subjective  judgment  as  to  their  meaning.  All  responses 
were  reviewed  by  an  independent  individual  who  had  no  health  care  affili¬ 
ation.  He  and  the  writer  placed  the  responses  into  general  categories. 
Differences  were  resolved  in  favor  of  the  independent  reviewer.  Therefore, 
any  bias  the  writer  may  have  from  his  years  of  experience  in  the  health  care 
field  was  reduced.  This  grouping  is  subjective  but  is  a  consequence  of  the 
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limited  to  areas  identified  for  comment. 

The  active  duty  population  at  Fort  Rucker  is  unusually  healthy  when 
compared  to  other  US  Army  posts.  The  incidence  of  hospital  dispositions 
reflected  in  The  Health  of  the  Army,  December  1980,  supports  this  statement. 
The  average  hospital  disposition  rate  per  1,000  soldiers  is  157.2  in  the 
United  States  compared  with  7.3  at  Fort  Rucker.  The  reason  may  be  that  the 
majority  of  military  personnel  are  in  flight  training  or  already  flight 
qualified.  Flight  qualification  requires  a  high  state  of  personal  health 
and  subjects  the  individual  to  an  annual  medical  flight  examination.  Physi¬ 
cal  examination  failure  removes  the  individual  from  flight  status  and  leads 
to  reassignment  from  Fort  Rucker  and  a  loss  of  monthly  flight  pay.  This  is 
a  strong  motivation  to  remain  healthy  and  on  flight  status.  Therefore,  the 
active  duty  response  of  the  study  may  be  limited  because  fewer  active  duty 
personnel  use  Lyster  Hospital  as  other  military  hospitals  and,  consequently, 
have  no  opinion  about  the  services. 

Three  assumptions  were  made  prior  to  the  study's  initiation.  First: 

The  Fort  Rucker  supported  population  would  remain  relatively  constant  in 
total  numbers  and  in  population  mix  between  active  duty,  dependents  of 
active  duty,  and  retirees  and  their  dependents  during  the  survey  period. 
Second:  Opinions  expressed  by  surveyed  personnel  would  truly  reflect  the 
general  beliefs  of  the  population.  Third:  Individuals  will  base  their 
responses  on  actual  inpatient  or  outpatient  experience  with  the  hospital  and 
not  on  heresay  or  rumors. 

Literature  Review 

"It  would  still  seem  that  one  of  the  best  ways  of  finding 
out  whether  you're  doing  a  good  job  is  to  ask  people.  Despite 
our  growing  sophistication  we  are  still  influenced  by  the  per¬ 
sonal  and  public  opinions  of  others.  If  our  aim  is  to  produce 
what  pleases,  it  ought  not  to  be  too  difficult  to  find  out  if 
we  have  succeeded."  o 
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The  majority  of  QA  writings  deal  with  solving  problems  already  identi¬ 
fied.  An  exception  to  this  is  Williamson’s  writings.  He  has  researched 
extensively,  using  a  modified  nominal  group  technique,  to  discover  problems 
and  apply  them  to  QA  programs.  He  specifically  directed  his  studies  toward 
medical  care  evaluation  studies  of  PSRO’s  and  performance  evaluation  projects 
of  the  JCAH.  This  technique  is  more  applicable  today  in  the  new  problem- 
oriented,  hospital-specific  QA  program  advocated  by  JCAH.  Williamson  believes 
that  using  the  hospital  staff  input  motivates  staff  involvement,  gives  a 
wider  perspective,  and  brings  attention  to  a  broader  range  of  methods  for 
assessing  QA.  He  concluded  that  the  judgments  of  local  providers  in  identi¬ 
fying  cost  effective  quality  assurance  priorities  is  highly  reliable  in 
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medical  institutions. 

The  JCAH’ s  QA  Guide  finds  several  sources  for  problem  identification. 

Two  sources,  the  practitioner  and  clinical  department,  are  discouraged  as  a 
hospital's  sole  source.  Individual  practitioners  have  a  limited  interest 
which  involves  a  few  patients.  Resources  would  not  be  used  efficiently 
concentrating  on  a  small  clinical  area.  Rotating  topics  between  departments 
can  lead  to  unnecessary  work  as  departments  grope  to  meet  their  quotas 
The  QA  Guide  does  suggest  that  QA  programs  collect  data  from  each  QA  activity 
and  from  other  internal  and  external  sources.  The  emphasis  is  on  the  quality 
assurance  system  generating  the  data  from  reports  and  committee  meetings. 

Only  passing  mention  is  made  of  staff  or  patient  surveys.^  External  information 
sources  center  on  PSRO1 s,  third  party  payers,  and  health  system  agency 
reports.  Military  hospitals  have  an  advantage  over  civilian  hospitals  in 
that  they  can  go  to  the  potential  patient  for  feedback  about  the  system's 
good  and  bad  areas.  This  ability  broadens  the  military  hospital's  data  potential 
for  assessment  and  problem  identification.  For  example,  the  patient  who  has 
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a  particular  reason  for  not  using  a  hospital  may  never  have  that  reason 
!  discovered  by  the  civilian  facility.  The  civilian's  hospital  choice  option 

is  not  available  to  most  soldiers  and  military  dependents  due  to  individual 
cost  constraints;  thus,  the  military  patient  routinely  use  the  military 
hospital.  The  potential  to  improve  services  by  linking  patient  expectations 
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;  with  outcomes  is  real. 

Thompson  writes  that  a  good  quality  assurance  program  takes  the  patient's 
i  perspective.  Patient  distrust  and  misunderstanding  can  lead  to  law  suits; 

I 

i  1 2 

i  thus,  aiding  patient  expectations  and  outcomes  will  reduce  liabilities. 

!  Obtaining  patient  and  prospective  patient  opinions  is  only  good  quality 

i 

assurance  practice. 

I  Van  Amring  and  Oestreicher  have  written  that  quality  assurance  encom- 

I 

|  passes  three  areas:  structure,  process,  and  outcome.  Structure  is  the 

facility's  capacity  to  render  services  such  as  a  building,  equipment,  and 

i  credentials.  Process  is  the  actual  care,  that  is,  putting  the  patient  in 

|  the  right  setting,  and  providing  the  right  services  at  the  right  time. 

I 

|  Outcome  is  the  result,  that  is,  the  improvement  or  maintenance  of  the  patient's 
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total  physical,  emotional,  and  social  wellbeing.  Again,  the  patient  can 

be  a  useful  source  of  problem  identification  in  the  areas  of  structure  and 

i 

1  outcome. 

To  emphasize  this  concept,  Schmadl  has  written  that  the  health  care 
profession  is  assuring  quality  and  that  the  quality  is  being  assured  for  the 

i 

patient.  Consumers  are  becoming  more  involved  in  local,  state,  and  national 
health  policies.  Providers  that  do  not  accept  the  patients'  right  or  ability 
to  question  or  provide  input  to  the  health  care  system  will  find  third  party 
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payers  and  accreditation  agencies  dictating  the  quality  standard  for  them. 
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A  community  oriented  health  care  facility  should  not  desire  this  outcome. 

Schmadl  writes  that  quality  assurance  is  not  a  means  to  itself,  but  a  method 
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of  initiating  change  with  a  purpose. 

The  importance  of  participant  input  to  a  quality  assurance  system  is 
emphasized  by  Vanloh,  et  al.,  as  the  feedback  mechanism  that  insures  a 
continuous  program  update  and  review.  This  supports  the  continuous  nature 
of  the  quality  assurance  program  and  its  use  as  a  cybernetic  control  system 
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to  effect  change. 

From  Fifer's  writings,  it  can  be  concluded  that  lack  of  provider  input 
into  recent  quality  assurance  programs  has  resulted  in  the  ineffectiveness 
of  the  programs  and  few  changes  in  physician  behavior  or  organizational 
performance.  The  former  quality  assurance  program  concentrated  on  quality 
control  rather  than  quality  improvement.  Actively  soliciting  provider  input 
into  the  problem-oriented,  hospital -specific  quality  assurance  programs  can 
make  quality  improvement  a  reality.^® 

Ackerman  has  found  that  active  participation  of  the  administrative 
staff  in  an  ongoing  peer  review  audit  at  Geisinger  Medical  Center  has  helped 
to  assess  current  problems  and  led  to  effective  institutional  and  departmental 
management  changes.  The  program's  strengths  were  its  peer  review  as  a  con¬ 
structive  method  of  identifying  weaknesses  and  management  improvement  which 
con-tributes  to  patient  care.^ 

Provider-patient  participation  in  quality  assurance  has  been  addressed 
on  a  limited  basis  by  a  different  group  of  writers,  under  the  label  of 
"Health  Care  Marketing";  that  is,  the  management  of  exchanges  between  the 
hospital  and  its  publics.  Exchanges  are  the  values  traded  and  publics  are 
all  organizations  and  people  external  and  internal  to  the  hospital  with 
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potential  or  actual  interaction  with  the  hospital.  The  use  of  marketing 

concepts  focusing  on  the  relationships  between  the  hospital  and  the  various 

publics  as  a  series  of  exchanges  provides  a  useful  addition  to  the  tradi- 
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tional  tools  of  hospital  management.  In  the  new  concept  of  quality  assur¬ 
ance  as  a  problem-oriented,  hospital-specific  program,  the  idea  of  utilizing 
the  different  hospital  publics  as  input  for  the  health  care  program  only 
makes  good  sense.  Marketing  can  be  a  valuable  tool  for  identifying  the 
unmet  health  service  needs  in  a  community,  for  helping  to  increase  the 
rational  deployment  and  development  of  hospital  resources  in  a  manner  that 

maximizes  efficiency,  and  for  serving  as  a  mechanism  for  increasing  the 

1 9 

satisfaction  of  all  purchasers  of  health  services. 

Levner  compares  hospitals  that  do  not  use  marketing  techniques  to  the 
railroads.  Theodore  LevittAs  management  classic  "Marketing  Myopia"  detailed 
how  railroads  met  their  demise  because  they  viewed  themselves  as  being  in 
the  railroad  business  instead  of  the  transportation  business.  Levner  addres¬ 
ses  hospitals  that  think  they  are  in  the  hospital  business  instead  of  the 

health  care  business.  She  warns  that  hospitals  not  matching  their  resources 
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and  activities  to  community  needs  will  not  survive  the  1980‘s. 

Similarly,  military  hospitals  that  do  not  use  marketing  techniques  to 
identify  their  community's  needs  may  not  go  under,  but  may  have  a  dissatis¬ 
fied  community.  This  dissatisfaction  will  result  in  a  high  level  of  patient 
complaints,  congressional  inquiries  into  hospital  activities,  and  a  greater 
demand  for  the  usage  of  the  Civilian  Health  and  Medical  Program  for  the 
Uniformed  Services  (CHAMPUS).  From  a  cost  standpoint,  it  is  more  expensive 
in  total  costs  to  pay  for  care  through  CHAMPUS  than  in  a  military  hospital; 
so,  maximum  use  of  a  military  facility  and  minimal  use  of  CHAMPUS  are  valid 
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hospital  goals. 

Ireland  notes  that  hospitals  are  in  the  business  of  serving  patient 

needs,  providing  the  best  quality  health  care  to  the  community  served.  Yet, 

the  rising  incidence  of  malpractice  suits  indicates  a  dissatisfaction  with 

the  services.  Hospitals  have  taken  an  inside  approach  to  delivering  their 
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product  and  have  not  surveyed  the  consumers  of  that  product.  A  marketing 

approach  provides  a  mechanism  to  measure  consumer  expectations. 

Falbert  and  Bonnen  wrote  about  using  marketing  techniques  to  solicit 

problems  from  physicians  who  were  eligible  to  practice  at  their  facility. 

Problems  were  identified,  corrective  actions  taken,  and  the  result  was  an 
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increase  of  2000  bed  days  over  a  one-year  period. 

Much  of  marketing  is  hospital -community  relations;  that  is,  hospitals 

responding  to  the  pulse  of  the  public  rather  than  marching  on  as  before. 

The  hospital  must  be  an  active  participant  in  the  health  care  process  and 

not  a  passive  link  between  provider  and  patient.  Ultimately,  the  community 

hospital  must  be  judged  by  the  satisfaction  its  programs  generate  among  its 
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identifiable  publics. 

The  question  may  arise:  Is  patient  satisfaction  a  good  measure  of 

quality  medical  care?  Does  not  this  merely  reflect  the  general  attitude 

toward  society  and  life?  Graff  writes  that  this  may  be  confusing  the  art  of 

healing  with  the  technical  aspects  of  quality  care.  Yet,  there  is  evidence 

that  patient  satisfaction  will  manifest  itself  in  appointment  keeping  and 

medication  taking.  Thus,  the  quality  is  of  little  value  if  the  patient  has 
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a  distrustful  perception  of  the  art. 

Quality  assurance  writers  are  recognizing  that  patients  and  providers 
are  a  good  source  of  problem  identification  and  evaluation.  Responding  to 
these  sources  usually  results  in  health  care  delivery  improvements.  The  new 


JCAH  requirements  for  QA  require  problem  identification.  The  use  of  market¬ 
ing  techniques  to  identify  population  segments  and  perspectives  can  be 
useful  in  problem  identification. 

Research  Methodology 

During  the  development  of  this  methodology  an  important  consideration 
was  applicability  to  other  US  Army  hospitals.  The  intent  was  for  other  US 
Army  hospitals  to  use  the  same  techniques  to  gather  data  about  health  care 
delivery  from  their  providers  and  patients.  In  developing  the  methodology, 
great  care  was  taken  to  minimize  the  manhours  spent  and  costs  involved  to 
the  hospital.  The  design  is  such  that  a  project  officer  or  noncommissioned 
officer  could  execute  the  project  with  minimal  clerical  and  mathematical 
help.  The  study  techniques  are  simple  but  flexible  enough  to  take  into 
consideration  the  mission  variations  between  different  US  Army  hospitals. 

To  make  the  methodology  complicated,  time  consuming,  and  costly  would  discou¬ 
rage  its  use  by  other  US  Army  hospitals  and  the  overall  value  of  this  project 
as  a  QA  mechanism. 

The  objectives  of  the  methodology  are: 

a.  To  divide  the  health  care  providers  and  patients  into  groups  with 
similar  relationships  to  the  health  care  delivery  system. 

b.  To  develop  a  survey  for  these  groups  which  allows  meaningful  input 
about  health  care  delivery. 

c.  To  identify  major  problem  areas  from  the  survey  results. 

d.  To  prepare  a  second  questionnaire  to  obtain  a  problem  priority  from 
the  surveyed  patient  personnel. 

e.  To  use  a  modified  nominal  group  technique  with  selected  hospital 
staff  to  solicit  problem  prioritization. 


f.  To  evaluate  the  responses  to  the  second  questionnaire. 

g.  To  compare  the  staff  and  patient  responses  with  each  other  and  with 
traditional  outside  agency  reports. 

h.  To  present  the  study  findings  to  the  hospital  quality  assurance 
committee  for  use  as  a  problem  source  document  in  the  hospital Js  problem- 
focused,  result-oriented  quality  assurance  program. 

Segmentation 

Segmenting  the  people  to  be  surveyed  into  groups  is  the  first  step. 
Segmenting  will  enable  the  hospital  to  obtain  the  perspectives  of  people 
delivering  and  receiving  health  care  at  Lyster  Hospital.  This  will  be 
important  since  traditional  performance  evaluations  come  from  external 
agencies  such  as  the  Joint  Commission  on  the  Accreditation  of  Hospitals  and 
the  Health  Services  Command  Inspector  General. 

MacStravic  calls  constituents,  the  people,  groups,  or  organizations 
that  interact  with  the  hospital.  The  constituents  are  divided  into  four 
groups:  external,  internal,  client,  and  colleagues.  Each  group  is  briefly 
described:  External  constituents  are  supporters,  suppliers,  regulators,  and 
the  community.  Supporters  are  groups  that  donate  time  or  money  to  the 
hospital.  Suppliers  are  companies  that  provide  facilities  and  equipment  to 
operate  the  hospital.  Regulators  are  accrediting  bodies  and  regulating 
agencies  that  permit  or  constrain  the  hospital's  operation.  Community  is 
the  general  public  not  having  an  exchange  with  the  hospital  but  having  the 
potential  for  such  an  exchange.  Internal  constituents  are  the  board  of 
trustees,  employees,  physicians,  and  volunteers;  physicians  differing  from 
employees  in  that  usually  there  is  not  a  formal  contract  between  the  hospi¬ 
tal  and  physician.  Client  constituents  are  patients,  clients,  and  public. 
Patients  are  individuals  presently  using  the  hospital's  services  as  an 


inpatient  or  outpatient.  Clients  are  people  receiving  services  but  not 
direct  patient  care.  The  public  is  individuals  benefitting  from  the  hospi¬ 
tals  services  but  not  receiving  them  directly,  such  as  parents  of  patient 

children.  Colleague  constituents  are  all  the  people  or  organizations  provi- 
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ding  similar  services. 

This  system  for  segmenting  the  population  was  considered  but  not  fully 
used  for  the  following  rationale:  As  a  military  hospital,  several  popu¬ 
lation  divisions  do  not  apply.  The  military  hospital  does  not  fit  into  the 
external  division.  There  are  no  supporters.  Suppliers  are  managed  by 
government-wide  contract  or  competitive  bid.  Regulators  more  closely  fit 
into  the  internal  classification,  board.  The  community  fits  into  the  client 
category  because  each  community  member  is  eligible  for  care  and  each  mili¬ 
tary  community  routinely  has  only  one  hospital.  The  internal  constituent 
category  does  reflect  some  military  hospital  relationships.  The  employees 
do  have  contractual  arrangements  with  the  hospital  and  volunteers  are 
utilized,  but  not  to  the  extent  experienced  in  civilian  hospitals.  Military 
volunteer  programs  are  routinely  operated  by  the  American  Red  Cross  and  are 
not  hospital  based  programs.  Physicians  are  either  contractual  employees 
with  the  hospital  or  members  of  the  US  Army,  not  independent  practitioners. 
The  committees  are  composed  entirely  of  hospital  employees  or  physicians, 
and  the  board's  representative  is  the  hospital  commander.  A  military  hospi¬ 
tal's  clients  are  similar  to  those  described  by  MacStravic.  Military  hospi¬ 
tals  do  have  colleague  constituents  similar  to  MacStravic' s  description. 
However,  it  is  unlikely  that  these  colleagues  are  in  a  good  position  to 
evaluate  the  quality  of  services  or  describe  health  care  delivery  problems. 


MacStravic's  constituent  divisions  do  offer  good  categories  for  division 
of  a  hospital's  publics.  Strict  application  to  Lyster  Hospital  or  any 
military  hospital  would  not  be  appropriate.  However,  some  ideas  will  be 
incorporated.  The  division  of  clients  (patients)  from  internal  (hospital 
workers)  would  be  very  applicable.  A  great  difference  lies  between  the 
individuals  receiving  health  care  and  the  individuals  providing  the  care. 

The  patients  at  Lyster  are  eligible  medical  care  beneficiaries  under 
Department  of  Defense  directives.  Several  categories  of  eligibility  for 
care  exists,  such  as:  active  duty  military;  active  duty  dependents;  and 
retired  military.  The  specific  categories  chosen  to  survey  were:  active 
duty;  their  dependents;  and  retirees  and  their  dependents.  The  reasons  for 
this  selection  relate  to  two  areas:  use  of  the  facilities  and  priority  for 
care.  The  Medical  Summary  Report,  Med  302,  documents  in  detail  inpatient 
and  outpatient  hospital  usage  by  the  different  patient  personnel  categories. 
An  analysis  of  patient  personnel  usage  from  July  1980,  to  and  including 
October  1980,  revealed  that  ninety  eight  percent  of  the  inpatient  care  and 
ninety  seven  percent  of  the  outpatient  care  is  provided  to  active  duty, 
their  dependents;  and  retirees  and  their  dependents  as  shown  in  table  1. 

In  addition,  US  Army  Regulation  40-3,  Medical,  Dental,  and  Veterinary  Care, 
provides  for  priority  of  health  care.  The  priorities  are:  first,  active 
duty;  second,  dependents  of  active  duty;  third,  senior  Reserve  Officer 
Training  Corps  personnel;  and,  fourth,  retirees  and  their  dependents.  Thus, 
priority  of  care  is  a  reason  for  dividing  the  patient  population  into  the 
three  segments.  Another  reason  is  the  physical  makeup  of  the  groups. 

Active  duty  personnel  are  generally  young,  healthy  men  and  women,  between 
the  ages  of  18  and  48,  who  undergo  active  physical  fitness  programs  and 


TABLE  1 


Osage  of  Lyster  US  Army  Community  Hospital 
by  Active  Duty  (AD) ,  Dependents  of  Active  Duty  (Dep  AD) , 
Retirees  and  Their  Dependents  (Ret) ,  and  Others 
Period  July  1980-October  1980 


Dep  AD 


Others 


July  80 
Admissions 
Clinic  Visits 


August  80 
Admissions 
Clinic  Visits 


September  80 
Admissions 
Clinic  Visits 


October  80 
Admissions 
Clinic  Visits 


Totals 
Admissions 
Clinic  Visits 


percent  of  Totals 
Admissions 
Clinic  Visits 


234 

25338 


170 

20126 
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routine  physical  examinations.  Dependents  of  active  duty  are  generally 
female  spouses  and  children  ranging  from  newborn  to  twenty-two  year  olds. 
Retirees  and  their  dependents  are  generally  fifty  years  of  age  and  older. 
Their  children  are  usually  past  the  age  eligibility  for  medical  care.  The 
health  care  needs  of  young,  active  people  are  usually  different  and,  thus, 
should  give  a  different  perspective  to  the  health  care  provided. 

The  traditional  military  division  of  inpatient  and  outpatient  care  will 
be  surveyed.  This  is  in  keeping  with  the  military  hospital's  ambulatory 
patient  care  program  versus  inpatient  care..  The  different  health  care 
experiences  of  an  inpatient  versus  an  outpatient  will  be  evaluated. 

Another  active  duty  soldier  who  has  a  different  perspective  of  the 
military  health  care  system  is  the  unit  commander.  This  individual  is 
responsible  for  the  continuous  maintenance  of  his  unit  at  combat  readiness 
and  the  completion  of  training  by  the  students  in  his  unit.  The  unit  com¬ 
mander  is  vitally  interested  in  keeping  as  many  soldiers  present  for  duty  as 
possible.  The  commander's  concern  is  not  so  much  with  the  efficiency  of 
care,  but  its  scope  and  effectiveness  in  delivering  a  healthy  soldier  to  his 
unit.  Medical  work  limitations  given  soldiers  inhibit  the  commander's 
ability  to  perform  his  mission  and  offer  the  soldier  a  possible  alternative 
to  work.  The  hospital's  inability  to  provide  certain  medical  specialties 
requires  the  soldier  to  travel  to  other  military  installations;  thus,  reduc¬ 
ing  his  present-for-duty  status.  Commanders  will  be  surveyed  to  obtain 
input  as  to  the  hospital's  mission  performance. 

Next  to  be  segmented  are  the  health  care  providers.  These  individuals 
are  employed  by  Lyster  Hospital  to  provide  patient  care  and  all  associated 
administrative  and  ancillary  services.  MacStravic  segments  the  internal 


constituents  into  the  board/committee,  physicians,  employees,  and  volun¬ 
teers.  The  traditional  Army  segmentation  is  officers,  enlisted  members, 
and  civilians.  Neither  segmentation,  in  and  by  itself,  was  considered 
appropriate  for  the  staff. 

The  groups  selected  were  physicians,  nurses,  administrators,  para¬ 
medical  personnel,  ancillary  personnel,  and  clerical  personnel.  Prior  to  a 
detailed  reason  for  each  group,  a  general  comparison  between  military  and 
civilian  hospitals  is  helpful.  Generally,  civilian  hospitals  have  a  board 
of  governors  that  is  legally  responsible  for  the  hospital's  operation.  They 
hire  an  administrator  to  manage  the  hospital.  Under  the  administrator  are 
the  various  administrative,  nursing,  and  ancillary  personnel  organized  into 
departments.  Usually,  assistant  or  associate  administrators  operate  these 
departments.  The  physicians  are  not  employees  of  the  hospital.  They  prac¬ 
tice  medicine  at  the  hospital  as  staff  members,  but  with  the  option  to 
practice  at  other  hospitals.  In  a  military  hospital,  the  hospital  com¬ 
mander  is  a  physician  and  responsible  for  the  hospital's  operation.  He  is 
the  equivalent  to  a  designated  representative  of  the  hospital  board.  Under 
the  commander  are  two  major  services:  administrative  services  and  profes¬ 
sional  services.  The  Chief,  Administrative  Services  is  an  administrator 
responsible  for  all  administration,  materiels  management,  and  comptrol- 
lership.  The  Chief,  Professional  Services  is  responsible  for  all  the  medical 
care  to  include  physician  care,  ancillary  services,  and  nursing.  Thus,  in 
the  military  hospital,  everyone  is  an  employee  but  the  division  is  made 
between  professional  and  administrative  services. 

The  traditional  Army  segmentation  of  officer,  enlisted,  and  civilian 


i 


VlW/lL1 


WIVOli 


personnel  would  not  consider  the  different  training  levels  attained  or  the 
different  provider-patient  relationships.  Officers  may  be  physicians, 
nurses,  administrators,  materiels  managers,  therapists,  dietitians,  or 
pharmacists.  To  ignore  the  different  educational  backgrounds  and  patient 
relationships  would  be  improper.  Enlisted  personnel  have  a  more  diverse 
background  ranging  from  laboratory  technologists  and  licensed  practical 
nurses,  to  clerk  typists  and  motor  vehicle  operators.  Civilian  employees 
run  the  gamut  from  physicians  to  housekeepers. 

Logically,  a  combination  of  MacStravic's  segmentation,  traditional  Army 
structure,  and  the  individual's  interaction  with  the  patient  was  chosen. 

The  groups  were  physicians,  nurses,  administrators,  ancillary  personnel, 
paramedical  personnel,  and  clerical  personnel. 

Reasons  for  selecting  physicians  were  the  unique  physician-patient 
relationship;  the  socialization  process  physicians  experience  during  medical 
school;  and  their  military  status  and  influence  as  officers,  department 
chiefs,  and  committee  chairmen. 

Nurses  were  selected  because  of  their  special  patient  relationship; 
their  responsibility  as  directors  of  the  hospital's  largest  department;  and 
their  formal  education. 

Administrators  were  selected  because  of  their  supply  and  service  sup¬ 
port  role;  their  continued  confrontation  with  providers  over  patient  care 
versus  resource  conservation;  their  education;  and  their  role  as  a  sounding 
board  for  patient  dissatisfaction. 

Ancillary  personnel  were  chosen  because  of  their  direct  patient  care 
support  role  and  their  educational  experience.  They  provide  pharmacy. 
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physical  therapy,  laboratory,  radiology,  and  social  work  services  under  the 
order  of  a  physician.  They  have  daily  contact  with  inpatients  and  outpat¬ 
ients  providing  direct  patient  care  services.  The  education  level  for 
ancillary  service  personnel  may  be  college  or  special  schooling.  The  special 
schooling  can  be  from  several  months  to  two  years  in  length.  Usually  there 
is  a  requirement  for  certification  by  a  state  or  national  board. 

Paramedical  personnel  are  the  medical  corpsmen,  nursing  assistants, 
emergency  medical  technicians,  and  licensed  practical  nurses  who  provide 
direct  patient  care  under  the  supervision  of  a  nurse  or  physician.  Their 
daily  interaction  with  patients  gives  them  a  personal  relationship  with  the 
patient  which  is  different  from  the  nurse's  or  physician's. 

Clerical  personnel  provide  the  administrative  support  to  the  hospital 
that  allows  its  day-to-day  operation  to  continue.  They  may  have  either 
direct  interaction  with  patients  as  receptionists  or  indirect  interaction, 
as  medical  records  clerks. 

In  summary,  the  external  or  patient  groups,  are:  active  duty;  their 
dependents;  retirees  and  their  dependents;  and  unit  commanders.  The  inter¬ 
nal  or  staff  groups  are:  physicians,  nurses,  administrators,  ancillary 
personnel,  paramedical,  and,  clerical  personnel. 

The  question  arose  with  respect  to  obtaining  adequate  input  about 
inpatient  or  outpatient  care  if  all  surveyed  individuals  were  randomly 
selected.  There  could  be  no  absolute  guarantee  that  a  recent  hospitali¬ 
zation  or  outpatient  visit  had  been  experienced.  For  this  consideration,  a 
month's  discharged  inpatients  were  chosen  to  survey.  A  separate  survey  of 
outpatients  was  considered  but  not  performed  for  two  reasons:  First,  the 
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Health  Services  Command  Outpatient  Satisfaction  Survey  was  given  in  January 
1981.  The  opinion  was  that  another  survey  of  outpatients  would  not  add  to 
the  problem  base;  and,  secondly,  it  was  projected  that  the  majority  of 
problems  identified  by  surveyed  personnel  were  to  be  outpatient  related. 
This,  in  fact,  was  the  case  as  of  the  sixty  three  problem  areas  identified 
by  staff,  only  six,  or  9.5  percent,  related  to  inpatient  areas.  Only  two, 
or  1.9  percent  of  the  105  areas  identified  by  patients,  related  to  inpatient 
care. 


Sample  Size  and  Selection  Process 

After  segmenting  the  staff  and  patients,  the  number  of  people  to  be 
surveyed  and  the  method  of  their  selection  was  determined.  A  census  of  the 
staff  was  taken;  that  is,  a  survey  was  sent  to  each  hospital  staff  member. 
With  the  patient  population,  a  sample  was  taken.  The  reasoning  for  each 
choice  follows: 

The  staff  at  Lyster  Hospital  is  relatively  small  compared  with  other 
Army  Hospitals.  The  total  military  personnel  assigned  is  356.  The  total 
civilian  work  force  is  205.  Two  documents  were  used  to  determine  the 
number  of  assigned  military  and  civilian  personnel.  The  Unit  Manning  Report 
lists  all  military  positions  in  the  hospital  with  an  individual  assigned 
against  each  position.  This  document  was  screened  and  a  listing  of  all 
military  personnel  by  position  was  prepared.  The  Lyster  Hospital  civilian 
personnel  alphabetical  roster  was  screened  and  a  listing  of  hospital  civi¬ 
lian  employees  established.  The  total  number  of  surveyed  employees  was: 

251  military  and  155  civilians.  The  Commander;  Chief,  Professional  Ser¬ 
vices;  Chief  Nurse,  and  Executive  Officer  were  not  surveyed.  These  indi¬ 
viduals  comprise  the  hospital  QA  committee;  and  thus,  significantly 
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influence  the  hospital's  direction.  If  one  of  these  individuals  believed  an 
area  to  be  a  problem,  his/her  position  within  the  organization  would  allow 
action.  Secondly,  the  purpose  of  the  project  was  to  compile  a  prioritized 
problem  list  for  the  QA  Committee.  Other  groups  not  surveyed  were  the 
Aeromedical  Activity,  Dental  Activity,  and  Veterinary  Activity.  The  mili¬ 
tary  and  civilian  personnel  were  divided  into  the  five  groups:  physicians, 
nurses,  administrators,  ancillary,  paramedical,  and  clerical.  The  division 
was  made  by  military  occupational  specialty,  specialty  skill  identifier,  and 
civilian  job  code.  A  listing  of  these  codes  and  their  groupings  is  at 
appendix  C. 

The  average  population  serviced  by  Lyster  Hospital  is  at  table  2. 
Approximately  one  percent  of  the  population,  in  equal  parts  among: 
active  duty,  dependents  of  active  duty,  and  retirees  and  their  dependents 
were  selected  to  be  surveyed.  Although  their  respective  population  strengths 
differ,  their  use  is  approximately  the  same.  One  hundred  and  fifty  ques¬ 
tionnaires  were  sent  to  each  group.  Individuals  to  receive  the  question¬ 
naires  were  selected  from  available  listings. 

The  active  duty  selection  was  accomplished  as  follows:  The  alpha¬ 
betical  listing  of  all  active  duty  personnel  at  Fort  Rucker  was  obtained 
from  the  US  Army  Aviation  Center  { USAAVNC )  Adjutant  General's  Office.  The 
total  number  of  names  on  the  listing  (7345)  was  divided  by  one  hundred  and 
fifty.  This  yielded  forty  eight;  thus,  every  forty  eighth  name  on  the 
roster  was  selected  for  a  questionnaire.  When  the  name  of  an  individual 
assigned  to  Lyster  Hospital  was  picked,  the  next  name  on  the  list  was 
chosen  to  replace  it. 


TABLE.  2 


Active  Duty,  Dependents  of  Active  Duty,  and  Retirees-' and  Their  Dependents 
Population  in  the  Fort  Rucker  Health  Services  Area 


Active  Duty- 


Dependents  of 


Retirees  and 
Their  Dependents  1 


13308 

13308 

13308 

12924 

12924 

12924 

12924 

13251 

13251 

13251 

13521 

13251 

13158 

171 


This  information  is  from  the  Comptroller,  US  Army  Aeromedical  Center,  Fort  Rucker, 
Alabama. 

1.  The  retiree  and  their  dependent  population  is  not  adjusted  each  month  but 
is  adjusted  as  new  population  information  is  received  from  the  Retiree  Services 
Center,  Adjutant  General's  Office,  US  Army  Aviation  Center,  Fort  Rucker,  Alabama. 


- 

'  Active  Dut 

October  79 

6855 

19020 

November 

6945 

21018 

December 

7028 

21219 

January  80 

7237 

21897 

February 

7417 

22425 

March 

7433 

22485 

April 

7508 

22749 

May 

7441 

22536 

June 

7222 

21909 

July 

6451 

22512 

August 

7520 

22794 

September 

7612 

.7  23046 

Mean 

7305 

21967 

Standard  Deviation 

246.9 

1116.5 

¥ 
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Active  duty  dependents  were  limited  to  those  living  in  Fort  Rucker's 
Post  housing.  An  alphabetical  listing  of  these  families  was  used.  The 
listing  was  maintained  at  the  USAAVNC  family  housing  office.  The  total 
number  of  names  on  the  roster  (1554)  was  divided  by  one  hundred  and  fifty; 
so,  every  tenth  individual  received  a  questionnaire. 

The  retirees  are  listed  on  two  rosters  at  the  USAAVNC  Retirement 
Services  Center.  See  Limitations,  pages  7  and  8.  The  number  of  retirees  on 
the  forty-mile  radius  list  (1873)  were  divided  by  one  hundred  and  fifty; 
every  thirteenth  name  was  selected.  In  addition,  questionnaires  were  sent 
to  the  members  of  the  retiree  council,  a  group  of  fourteen  retired  officers 
and  enlisted  personnel.  This  group  was  selected  as  an  expert  group  for 
retiree  affairs. 

Each  of  thirty  eight  battalion  or  unit  commanders  was  sent  a  question¬ 
naire.  Questionnaires  were  not  sent  to  brigade  commanders  and  large  inde¬ 
pendent  unit  commanders;  as  these  individuals  are  members  of  the  Lyster 
Hospital  Health  Care  Consumer  Committee  and  have  a  direct  input  to  the 
hospital  commander. 

The  mailing  lists  were  recorded  on  a  programmable  typewriter  for  use 
with  the  second  survey.  Addresses  were  typed  on  gummed  labels,  placed  on 
the  cover  letter,  and  mailed  in  window  envelopes.  This  method  conserved 
time  in  address  preparation  and  gave  a  personal  touch  to  each  letter. 

The  inpatient  and  outpatient  samples  were  taken  in  this  manner:  Each 
inpatient  discharged  in  December  1980  was  sent  a  questionnaire.  This  repre¬ 
sented  approximately  eight  percent  of  the  year's  inpatients.  Outpatients 
w ®r#>  surveyed  using  the  annual  Health  Services  Command  Outpatient  Satis¬ 
faction  Survey.  Each  hospital  in  Health  Services  Command  is  allocated  a 
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number  of  surveys  based  upon  the  daily  average  clinic  visits.  Lyster  Hospi¬ 
tal  was  allocated  175  questionnaires  based  upon  515  average  daily  outpatient 
visits.  The  survey  is  taken  during  one  day.  Every  third  outpatient  visi¬ 
ting  a  clinic  is  given  a  survey.  The  data  is  sent  to  Health  Services  Command 
for  computation  and  analysis.  The  results  are  returned  to  the  hospital  for 
evaluation. 

A  separate  outpatient  survey  was  not  developed.  It  was  believed  that  a 

majority  of  comments  from  the  mailed  survey  would  relate  to  outpatient  care. 

Lyster  experiences  approximately  500  outpatient  visits  a  day  as  compared  to 

26 

twenty  inpatients  a  day. 

Another  reason  for  using  the  Outpatient  Satisfaction  Survey  was  to 
compare  its  findings  with  the  findings  of  the  mailed  surveys.  Similarities 
and  differences  could  be  important  in  determining  the  usefulness  of  each. 

Essentially,  the  questionnaires  for  active  duty  personnel,  active  duty 
dependents,  and  retirees  and  their  dependents  were  identical.  They  were 
open-ended  so  that  the  individual  could  comment  on  any  area.  They  asked  for 
areas  of  good  performance  and  areas  needing  improvement.  This  allowed  the 
individual  to  comment  on  whatever  is  good  or  bad  without  leading  questions. 

A  cover  letter  signed  by  the  hospital  commander  explained  the  question¬ 
naire's  purpose,  that  a  second  questionnaire  would  be  sent,  and  that  the 
project  was  very  important  to  the  hospital.  The  commander's  signature  on 
the  letter  attached  more  authority  and  credibility  to  the  questionnai re 
than  if  it  were  signed  by  a  lower  ranking  individual  or  nonphysician.  See 
appendix  E  for  a  letter  and  questionnaire  sample. 

Initial  Survey  Development  and  Use 

The  survey  developed  for  the  hospital  staff  is  at  appendix  D.  The 
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questionnaire  was  designed  to  solicit  responses  about  patient  care.  A  cover 
disposition  form  was  used  to  explain  quality  assurance,  the  purpose  of  the 
survey,  the  purpose  of  the  group  meetings,  and  how  the  information  would  be 
used.  Each  survey  was  individually  addressed  by  name  and  section  to  ensure 
receipt  by  each  staff  member.  A  notice  was  placed  in  the  hospital  weekly 
bulletin  two  weeks  after  the  survey  was  distributed  reminding  the  staff  to 
complete  the  questionnaire.  A  copy  of  the  questionnaire  was  attached  to  the 
bulletin. 

The  questionnaire  to  commanders  was  shorter.  Military  unit  commanders 
have  very  demanding  jobs  requiring  long  hours  and  being  constantly  on  call. 
The  questionnaire  was  designed  to  allow  a  commander  to  respond  with  a  minimum 
of  effort.  The  cover  letter  was  oriented  toward  obtaining  input  about 
hospital  roadblocks  to  mission  accomplishment,  how  the  input  would  be  used, 
and  the  acknowledgement  that  commanders  are  very  busy  but  thei>  time  spent 
in  completing  the  questionnaire  would  be  beneficial  to  all  concerned. 

Again,  the  letter  was  signed  by  the  hospital  commander  to  give  a  commander 
to  commander  communication.  See  appendix  F  for  sample. 

The  questionnaire  for  the  retiree  council  was  the  same  as  for  other 
retirees.  However,  the  cover  letter  was  changed  to  explain  the  project  in 
more  detail,  to  emphasize  the  council  members1  special  position,  and  to  have 
the  members  evaluate  the  results  of  the  initial  survey  as  a  group.  See 
appendix  G  for  a  sample. 

The  inpatient  questionnaire  was  not  completely  open-ended.  There  were 
specific  areas  in  which  comments  were  desired.  They  were  admissions,  physi¬ 
cians,  nurses,  food  service,  and  room  cleanliness.  A  general  comments 
section  was  established.  The  cover  letter  was  signed  by  the  commander.  It 
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was  written  to  solicit  constructive  comments  and  to  explain  what  would  be 
done  with  the  comments.  See  appendix  H  for  a  sample. 

Recording  Questionnaire  Responses 

Initial  questionnaire  responses  were  separated  into  survey  groups,  such 
as  retirees  and  their  dependents  or  active  duty.  Each  group^s  responses 
were  listed  individually.  The  individual  responses  were  consolidated  into 
like  areas.  The  group's  consolidated  list  was  incorporated  into  a  patient 
or  staff  list.  The  groupings  and  consolidations  were  reviewed  by  a  non¬ 
health  field  individual  familiar  with  survey  and  marketing  techniques. 

Differences  were  discussed  and  resolutions  were  made  in  favor  of  the  non¬ 
health  field  individual.  It  is  believed  that  this  helped  reduce  the  chance 
of  inappropriately  grouping  the  data.  The  areas  identified  most  by  one 
group  were  the  topics  for  prioritization  by  the  staff  or  patients  as  appro¬ 
priate. 

At  this  time  a  consolidated  listing  of  staff  identified  problems  was 
presented  to  the  QA  committee  for  discussion.  This  helpecf  prepare  the  QA 
committee  for  the  prioritized  listing  to  come  and  gave  a  current  staff 
assessment  of  the  hospital's  performance.  The  list  was  complete  so  that 
items  not  appearing  in  the  final  problem  list  would  be  known  to  the  committee. 

Second  Questionnaire 

The  second  questionnaire  was  developed  from  the  responses  to  the 
initial  questionnaire.  Areas  of  improvement  identified  in  approximately 
ten  percent  of  the  returned  surveys  were  listed  for  prioritization.  In 
addition  to  the  areas  identified  by  specific  groups  the  six  areas  most 
identified  by  all  patients  as  a  whole  were  listed  for  prioritization.  Each 
group,  active  duty,  dependents  of  active  duty,  and  retirees  and  their  dependents, 
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were  sent  a  different  survey,  appendices  I,  J,  and  K.  The  cover  letter  for 
each  survey  was  the  same.  The  letter  thanked  the  individual  for  participating, 
asked  for  completion  of  the  second  questionnaire,  and  ensured  the  respondent 
that  all  comments  were  being  considered. 

The  second  survey  for  commanders  listed  the  areas  identified  by  at 
least  ten  percent  of  the  commanders.  The  cover  letter  thanked  the  com¬ 
manders  for  their  initial  participation,  asked  that  the  second  questionnaire 
be  completed,  and  ensured  them  that  every  identified  problem  would  be  consi¬ 
dered  by  the  QA  committee,  appendix  L. 

The  second  patient  questionnaire  results  were  recorded  in  a  matrix  by 
patient  group.  Two  matrices  were  developed  for  each  patient  group.  One 
matrix  was  for  ranking  group  specific  problems  and  the  other  matrix  was  for 
ranking  general  patient  problems.  The  matrices  were  constructed  with  problems 
as  columns  and  rankings  as  rows  to  ease  statistical  calculations. 

Statistics 

The  data  collected  will  be  in  two  forms.  First  is  a  frequency  listing 
of  problems  initially  identified  by  different  groups.  The  importance  of 
these  problems  will  be  determined  by  their  frequency. 

The  second  data  collection  will  be  prioritized  problem  rankings  by  the 

groups.  The  Kendall  Coefficient  of  Concordance  (W),  Friedman  Two-Way  Analysis 
o 

of  Variance  { Xr  ) ,  and  multiple  comparison  test  (Rjs)  will  be  used  on  these 
data. 

The  Kendall  W  measures  the  extent  of  association  among  several  sets  of 
rankings  (judges)  of  several  entities  (problems).  The  W  is  useful  in  deter¬ 
mining  agreement  among  several  judges  and  association  among  three  or  more 
variables.  The  value  is  from  zero  to  one.  Zero  is  perfect  random  association 
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or  indifference.  One  is  perfect  agreement  and  association. 


No  tables  exist  stating  exactly  when  W  is  a  good  or  bad  association, 

thus,  its  significance  must  be  tested.  The  significance  of  W  is  tested 

using  the  W,  number  of  judges,  and  number  of  problems  being  ranked.  This 

produces  a  value  which  is  compared  to  a  chi  square  table  for  a  determined 

level  of  significance.  For  this  paper  *  =  .005,  the  probability  being  the 

association  occurred  by  chance.  It  is  possible  to  have  a  W  value  that  is 

low  and  a  high  level  of  significance.  This  indicates  the  association  found 

is  significant  even  though  the  W  is  low  and  one  would  assume  otherwise.  The 

2 

value  is  given  as  X  . 

In  computing  the  W,  the  total  value  of  each  problem's  rankings  is 
summed.  It  is  called  Rj.  A  low  total  Rj  indicates  the  problem  received 
many  ones  and  twos  from  the  judges.  This  indicates  the  problem  is  important. 
Likewise,  a  high  Rj  value  indicates  the  problem  is  not  as  important.  The 
Rj's  are  compared  to  find  significance  among  the  problems  by  two  methods. 

One  method  to  examine  the  Rj's  is  the  Friedman  Two-way  Analysis  of 
Variance.  This  tells  if  the  judges  had  significant  agreement,  that  is,  one 
problem  was  more  important  than  another.  The  test  does  not  indicate  which 
problem  is  more  important  but  that  the  Rj  totals  were  different  enough  to 
indicate  a  preference. 

The  mu.tiple  comparison  test  provides  a  numerical  value  at  a  1evel  of 
significance  among  Rj's.  It  is  possible  to  determine  which  problems  are 
significantly  more  or  less  important  by  comparing  the  individual  Rj's.  The 
level  of  confidence  used  is*  =  .05. 

Appendix  M  offers  a  detailed  explanation  of  the  statistics  with  sample 
problems  and  calculations. 


Modified  Nominal  Group  Technique 

The  nominal  group  technique  is  a  judgment  process  where  structured 

group  judgments  are  used  in  place  of  nonstructured  open  group  interactions. 

For  example,  the  group  meets  to  consider  a  problem.  Each  group  member 

outlines  his/her  solutions  in  writing.  All  solutions  are  placed  on  a  board 

for  all  group  members  to  see.  Without  discussion,  all  group  members  vote  in 

writing  on  the  test  solution.  The  majority  rules.  Williamson  modified  this 

technique  in  a  quality  assurance  program  during  a  fourteen-year  period.  His 

technique  consisted  of  selecting  a  mul tidiscipl ined  team  composed  of  physicians 

nurses,  technicians,  administrators,  and  front  desk  personnel.  This  team 

was  trained  by  simulating  a  priority  session.  During  this  session  a  list  of 

problems  was  developed.  After  the  training  session  a  three  to  four  week 

incubation  period  elapsed  prior  to  the  actual  priority  meeting.  This 

allowd  the  team  members  to  think  about  the  topics,  think  of  new  topics,  and 
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read  or  research  into  a  new  area.  The  priority  setting  meeting  consists 
of: 

a.  The  coordinator  gives  an  introduction  that  explains  the  purpose  of 
the  meeting. 

b.  Each  member  has  an  opportunity  to  write  down  different  topics  for 
discussion. 

c.  Each  member  may  sequentially  present  one  topic  from  his/her  list  to 
the  group.  The  topics  are  discussed  to  describe  the  impact  on  providers  and 
patients  and  the  change  needed  to  effect  improvement. 

d.  Each  member  weighs  the  importance  of  each  topic  numerically. 

e.  The  numerical  weights  are  averaged  for  each  topic. 

f.  The  group  discusses  the  topics  individually  as  to  placement  on  the 


topic  list. 


g.  The  group  numerically  weighs  each  topic  again.  The  coordinator 
totals  the  numerical  weights  to  develop  the  final  prioritized  list. 

After  the  meeting,  the  prioritized  list  is  sent  to  the  governing  board. 
The  entire  procedure  takes  approximately  two  hours  when  led  by  an  experi¬ 
enced  individual.  This  process  was  believed  to  be  too  long  for  strict  appli¬ 
cation  at  Lyster  Hospital.  The  process  that  was  used  with  the  staff  groups 
i s  as  fol lows: 

a.  The  coordinator  briefs  the  group  on  the  hospital's  problem-focused, 
result-oriented  quality  assurance  program. 

b.  The  group  is  briefed  on  the  staff  survey's  purpose  of  soliciting 
problem  areas. 

c.  The  group  is  asked  to  prioritize  the  problems  numerically. 

d.  The  coordinator  computes  each  item's  numerical  value  and  lists  the 
items  in  the  priority  order. 

e.  The  coordinator  asks  each  individual  to  comment  on  the  list. 

After  each  individual  comments,  the  disucssion  is  opened  to  any  member  for 
additional  comments. 

f.  Each  member  is  asked  to  prioritize  the  problems  again. 

g.  The  groupJs  prioritized  list  is  recorded  for  inclusion  with  other 
like  groups  and  the  staff  as  a  whole. 

The  reason  that  the  groups  were  kept  to  like  workers  was  to  obtain  a 
perspective  from  that  work  group  about  health  care  delivery  and  reduce  as 
much  as  possible  the  effect  of  group  dynamics.  Lyster  Hospital  has  a  varied 
assortment  of  employees  with  educational  levels  from  no  school  to  medical 
school  and  a  variety  of  economic  backgrounds.  In  addition,  the  military 
rank  structure  poses  another  barrier  to  individuals  interacting  freely  in  a 
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group  discussion.  It  was  judged  best  to  keep  the  groups  as  like  as  possible 
with  regard  to  rank  structure  and  education.  For  the  group's  physicians, 
nurses,  administrators,  paramedics,  and  clerical,  this  posed  no  problem. 

For  ancillary  personnel,  separate  meetings  were  held  for  technicians  and 
officer/ senior  graded  civilian  personnel.  Undoubtedly,  this  reduced  the 
affect  of  military  rank  on  group  dynamics.  The  results  of  the  modified 
nominal  group  discussions  were  recorded  by  groups  and  then  consolidated  into 
a  hospital  staff  prioritized  list. 

Summary  of  Methodology 

In  summary,  the  steps  followed  in  preparing,  executing,  and  evaluating 
the  data  are: 

a.  Segment  the  population  and  staff  into  groups  with  like  perspec¬ 
tives  or  uses  of  the  health  care  delivery  system. 

b.  Survey  the  groups  for  problem  areas  and  high  performance  areas. 

c.  Evaluate  the  initial  questionnaire  results. 

d.  Develop  a  second  survey  asking  for  ranking  of  identified  problems. 

e.  Conduct  modified  nominal  group  discussions  with  various  staff 
groups. 

f.  Evaluate  the  results  of  the  second  survey  and  group  discussions 
using  statistical  methods. 

g.  Prepare  a  final  problem  list  from  patients  and  staff  to  the 
Quality  Assurance  Committee. 
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DISCUSSION 

This  methodology  requires  two  separate  data  evaluations.  The  first 
evaluation  is  the  selection  of  problems  for  ranking  from  the  initial  patient 
and  staff  questionnaires.  The  second  evaluation  is  the  results  of  the 
problem  ranking  by  the  patient  and  staff  groups.  The  discussion  will  begin 
with  the  initial  questionnaire  results  as  to  what  was  collected,  how  it  was 
grouped,  and  what  problems  were  chosen  for  ranking.  An  initial  evaluation 
will  be  performed  on  patient  and  staff  data  for  general  trends.  The  second 
questionnaire  rankings  will  be  evaluated  for  statistical  significance.  Com¬ 
parisons  will  be  made  between  the  patient  and  staff  ranking  and  among  patient 
and  staff  groups. 

The  problems  identified  in  the  first  questionnaire  and  the  problems 
ranked  in  the  second  questionnaire  will  be  discussed  with  respect  to  their 
input  to  the  hospital's  quality  assurance  program.  Problems  will  be  dis¬ 
cussed  as  structure,  process,  or  outcome.  Briefly,  structure  problems  are 
the  capacity  of  a  hospital  to  render  quality  services.  The  key  objectives 
of  the  structure  standards  are  to  assure  that  the  appropriate  services  are 
available  and  accessible  to  patients,  that  the  health  and  safety  of  patients 
are  protected,  and  that  facilities  have  the  organizational  capacity  to 
deliver  care  that  meets  professionally  accepted  standards.  Process  stand¬ 
ards  are  based  upon  the  resources  used  and  the  procedures  performed  in  the 
provision  of  care.  They  are  the  hands-on  type  care  delivered.  Outcome 
standards  are  those  used  to  measure  the  patient's  health.  The  main  outcome 
question  to  answer  is:  Has  the  care  rendered  improved,  or  not  deteriorated 
beyond  what  is  expected,  the  prognosis  for  the  patient's  condition? 
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The  results  of  the  first  and  second  questionnaires  will  be  compared  to 
the  inpatient  questionnaire  and  the  Health  Services  Command  Outpatient 
Satisfaction  Survey.  Additional  comparisons  will  be  made  between  the  findings 
of  the  Health  Services  Command  Annual  General  Inspection,  and  the  Joint 
Commission  on  the  Accreditation  of  Hospitals  1981  survey. 

The  response  to  the  initial  questionnaire  was  very  low,  twenty-six 
percent  for  patients  and  seventeen  percent  for  staff,  for  an  overall  response 
of  twenty-two  percent.  Some  reasons  for  the  response  were  addressed  in  the 
introduction:  apathy,  previous  poor  community  relations,  and  fear  of  reprisal. 
When  the  new  commander  took  over  in  July  1980,  one  major  problem  was  staff 
and  community  attitude.  The  community  did  not  believe  the  hospital  was 
interested  in  their  health.  The  staff  believed  no  one  cared  what  they  did. 
Because  of  this  attitude  problem,  attempts  to  improve  communications  and 
solve  problems  met  with  suspicion  and  apathy  from  the  staff  and  community. 

Only  through  the  commanders  persistence  to  improve  this  attitude,  has  a 
change  come  about. 

The  second  questionnaire  had  a  thirty-two  percent  response  rate  from 
patients  and  a  twenty-one  percent  participation  rate  from  staff.  The  improve¬ 
ment  may  support  the  idea  that  some  problems  were  subsiding. 

The  response  rate  may  have  increased  with  advanced  publicity  about  the 
questionnaires  or  increased  command  emphasis.  A  letter  to  proposed  participants 
asking  if  they  would  participate  may  have  eliminated  those  nonresponders  and 
allowed  replacement.  This  should  be  considered  in  future  sampling  techniques 
but  care  must  be  taken  not  to  influence  the  randomness.  Increased  command 
emphasis  often  influences  the  responder  into  writing  what  is  expected  instead 
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of  what  he  thinks. 


The  problem  with  a  small  sample  is  the  data's  validity.  The  wrong 
conclusions  could  be  drawn  or  the  real  problems  missed.  However,  the  similar¬ 
ities  among  problems  identified  by  the  patients  and  staff  would  support  the 
idea  that  those  problems  are  real  to  the  hospital  and  community.  The  idea 
of  sampling  again  was  considered  but  rejected  because  of  the  manpower  costs 
involved  and  problem  similarity.  The  initial  mailing  and  data  recording 
required  approximately  twenty-two  hours  or  thirty-two  percent  of  the  project 
time.  See  appendix  N.  A  goal  of  the  methodology  was  to  keep  the  manpower 
time  and  cost  low  so  that  the  methodology  would  be  attractive  to  other 
military  medical  facilities. 

First  Questionnaire  Results  -  Patients 

Approximately  four  weeks  after  the  initial  questionnaires  were  mailed 
to  the  patients,  the  last  questionnaire  was  returned.  The  response  from  the 
patient  groups  was:  Active  Duty,  30/150  =  20%;  Dependents  of  Active  Duty, 

38/150  =  25.3%;  Retirees  and  their  dependents,  41/150  =  27.3%;  and  commanders, 
19/38  =  50%.  Ninety-two  different  problems  were  identified  by  all  the 
groups.  Active  duty  personnel  identified  twenty-four  problems;  dependents 
of  active  duty  identified  fifty-four  problems,  retirees  and  their  dependents 
identified  forty-one  problems;  and  commanders  identified  thirty-five  problems. 

A  detailed  listing  of  all  problems  identified  by  patient  group  is  at  table 
3.  The  table  was  compiled  by  separately  listing  each  identified  problem  by 
patient  group.  Each  group's  problems  were  consolidated  into  a  master  list 
for  that  group.  The  consolidated  problems  were  placed  under  major  headings. 

The  problems  presented  were  the  basis  for  selection  of  headings.  For  example, 
conwents  common  to  one  area  were  grouped  together  such  as  those  about  the  pharmacy 
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and  emergency  room.  Problems  that  could  not  be  grouped  under  a  heading  were 
listed  separately.  An  example  is  the  many  comments  made  by  unit  commanders. 

The  problems  chosen  for  ranking  were  those  general  or  specific  problems  identified 
by  the  patient  groups.  In  some  instances,  general  problem  areas  were  chosen 
because  to  rank  individual  problems  without  considering  the  problem's  general 
nature  would  result  in  significant  problem  areas  being  overlooked.  For 
example,  many  patients  identified  staff  attitude  problems  but  not  in  those 
exact  words.  These  attitude  problems  were  identified  as  rudeness,  lack  of 
empathy,  bad  attitude,  or  impolite  physicians  and  receptionists.  Considered 
separately,  these  problems  would  not  have  sufficient  frequency  to  be  placed 
on  the  problem  list  to  be  prioritized. 

An  initial  analysis  of  the  problems  identified  by  all  patient  groups 
and  the  unit  commanders  are:  More  Physicians  Needed,  44  of  128  =  34.4%; 

Improve  the  Pharmacy,  43  of  128  =  33.6%;  Improve  the  Staff  Attitude,  40  of 
128  =  31.3%;  Improve  the  Appointment  System,  22  of  128  =  17.2%;  Improve 
the  AMIC-GMC,  20  of  128  =  15.6%;  and,  Improve  the  Pediatric  Clinic,  13  of 
128  =  12.5%.  It  should  be  noted  that  attitude  problems  reflected  in  speci¬ 
fic  clinic  areas  were  counted  against  the  clinic  and  as  attitude  problems. 

The  reasoning  was  that  the  problem  was  a  hospital  attitude  problem  and  a 
problem  with  the  specific  clinic  or  person. 

In  analyzing  these  problems  from  a  quality  assurance  viewpoint  of 
structure,  process,  and  outcome;  the  first  four  problems  appear  to  be  struc¬ 
ture.  The  last  two  may  be  structure  and  process.  It  appears  that  people 
are  identifying  problems  that  are  structural  in  nature.  There  seems  to  be 
little  complaint  with  the  care  delivered.  If  all  the  patient  problems  are 
considered  as  to  structure,  process,  and  outcome;  structure  problems  are 
mentioned  on  eighty  two  of  the  ninety  two  problems  identified.  The  ten 
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problems  considered  possible  process  are:  general  emergency  room  treat¬ 
ment;  a  misprescribed  drug;  general  gynecology  treatment;  physical  therapy, 
opthalmology-otolaryngology;  immunization,  pediatric  vitamin  policy;  nurse 
practitioners;  general  care  of  the  AMIC-GMC;  and  improved  follow-up  care. 

These  process  problems  represent  10.9  percent  of  all  problems.  No  judgment 
can  be  made  about  an  eleven  percent  dissatisfaction  rate  with  medical  care 
in  comparison  to  other  military  or  civilian  hospitals.  However,  consider¬ 
ation  of  each  individual  group  indicates  where  a  group  has  trouble  with  the 
health  care  system. 

Active  duty  personnel  identified  the  following  areas  most  often: 

Pharmacy,  9  of  30  =  30%;  Staff  Attitude  Problems,  6  of  30  =  20%;  the 
Emergency  Room,  5  of  30  =  16.7%;  and  the  Appointment  System,  4  of  30  = 

13.3%.  It  should  be  noted  that  5  of  30  =  16.7%  stated  that  there  were  no 
bad  areas.  The  active  duty  personnel  did  not  identify  the  AMIC-GMC  or 
Aviation  Medicine  Clinic  as  problem  areas,  although  these  areas  are  where 
primary  care  is  received  and  has  the  greatest  potential  for  problems.  The 
Pharmacy  was  identified  as  a  problem  by  more  active  duty  personnel  than  any 
other  area.  The  comments  about  the  appointment  system  are  interesting. 

Active  duty  personnel  have  first  priority  for  specialty  clinic  appointments 
and  have  a  walk-in  clinic  for  primary  care,  yet  these  were  identified  as 
problems.  What  this  probably  reflects  is  the  soldiers'*  dependents'  problems 
with  entry  to  the  health  care  system. 

Dependents  of  active  duty  personnel  identified  the  following  problems: 

Staff  Attitude,  23  of  38  =  60.5%;  Pharmacy,  21  of  38  =  55.3%;  More  Physicians, 

18  of  38  =  47.4%;  Pediatrics,  13  of  38  =  34.2%;  AMIC-GMC,  13  of  38  =  34.2%; 
and  the  Emergency  Room,  8  of  38  =  21.1%.  The  areas  identified  were  those 
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most  used  by  the  dependents  of  active  duty.  The  AMIC-GMC,  Pediatric  Clinic, 
and  Emergency  Room  are  the  primary  health  care  entry  points  for  depend¬ 
ents.  The  Pharmacy  provides  all  outpatient  medications.  The  large  number 
of  responses  about  attitude  indicate  that  the  dependents  of  active  duty  have 
fewer  health  care  expectations  met  than  the  active  duty  or  retirees  and 
their  dependents.  The  dependents  of  active  duty  comprise  the  largest  seg¬ 
ment  of  the  population  supported  and  this  group  is  having  more  perceived 
trouble  with  the  health  care  system  than  the  other  group.  It  should  be  a 
target  group  for  improving  hospital  services. 

The  areas  identified  by  at  least  ten  percent  of  the  retirees  and  their 
dependents  were:  Physician  Shortage,  15  of  41  =  36.6%;  Appointment  System, 
14  of  41  =  34.1%;  Dental  Care,  8  of  41  =  19.5%;  Pharmacy  Service,  7  of  41 
=  17.1%;  Otolaryngology  -  Ophthalmology,  5  of  41  =  12.2%;  Gynecology,  4  of 
41  =  9.8%;  and  Physical  Exams  for  Retirees,  5  of  41  =  9.8%.  Retirees  and 
their  dependents  appear  to  have  major  problems  getting  into  the  health  care 
system  and  obtaining  the  service  they  expect  to  be  available.  Identifying 
problems  with  the  appointment  system  and  the  physician  shortage  would  support 
this.  Access  to  care  is  a  major  perception  problem  with  retirees. 

Unit  commanders  identified  four  areas  as  major  problems.  These  were: 
Initiate  OB  Service,  3  of  19  =  15.8%;  Pharmacy,  6  of  19  =  31.6%;  Improve 
Profiles,  3  of  19  =  15.8%;  and  Improve  Staff  Attitude,  5  of  19  =  26.3%.  The 
unit  commanders  appeared  to  have  no  problems  with  the  entry  into  the  system 
or  the  quality  of  care  provided.  What  bothered  them  the  most  were  hospital 
areas  that  kept  their  troops  from  performing  duty.  Waits  at  the  pharmacy, 
unclear  duty  limitations  prompted  by  illness  or  injury;  and  the  use  of 
civilian  obstetricians  who  do  not  understand  the  soldiers'  role  were  major 


problems.  These  civilian  physicians  often  place  the  soldier  in  a  nonwork 
status  long  before  delivery  and  create  manpower  shortages  for  the  unit 
commander.  The  commander  wants  his  troops  returned  to  work  as  quickly  as 
possible. 

In  addition  to  the  problems  reported,  the  patient  groups  were  asked  to 
identify  best  performance  areas.  These  areas  would  indicate  a  meeting  of 
patient  expectations  and  the  health  care  delivered.  There  were  forty  two 
different  clinics,  services,  or  individuals  identified  as  best  performance 
areas.  The  responses  were  grouped  like  the  problem  areas  and  are  displayed 
at  table  4.  The  areas  with  the  highest  positive  response  were:  Pediatrics, 

37  of  128  or  28.9%;  Emergency  Room,  31  of  128  or  24.2%;  Dental  Clinic,  16 
of  128  or  12.5%;  Inpatient  Care,  16  of  128  or  12.5%;  EENT  Clinic,  16  of  128 
or  12.5%;  Gynecology  Clinic,  15  of  128  or  11.7%;  Pharmacy,  14  of  128  or 
10.9%;  and  the  Acute  Minor  Illness-General  Medicine  Clinic,  12  of  128  or 
9.4%.  It  is  interesting  to  note  that  the  first  six  areas  are  all  direct 
patient  care  areas.  This  could  indicate  that  patients  derive  more  satis¬ 
faction  from  the  direct  care  contact  than  the  other  services  connected  with 
patient  care.  Of  the  forty  two  areas  identified,  27  or  64.3%,  are  direct 
patient  care  areas. 

from  a  quality  assurance  standpoint  that  considers  problems  as  structure, 
process,  or  outcome,  the  majority  of  the  best  performance  areas  are  in  the 
process  or  direct  patient  care  mode.  The  others  are  in  the  structure  mode 
while  none  are  in  the  outcome  mode. 

Active  duty  personnel  identified  pediatrics  as  the  best  area,  10  of  30 
=  33.3%.  The  next  most  identified  areas  were  Dental  Clinic  and  Pharmacy 
each  being  identified  by  5  of  30  =  16.7%.  The  area  where  active  duty  personnel 
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receive  routine  sick  call  treatment  was  not  identified  as  a  best  performance 
area. 

Dependents  of  active  duty  identified  the  Pediatric  Clinic,  24  of  38  = 
63.2%,  and  Gynecology  Clinic,  11  of  38  =  28.9%,  the  most  as  best  performance 
areas.  The  next  closest  area  was  the  Emergency  Room,  8  of  38  =  21.1%. 

The  individual  groups  had  different  perspectives  on  what  they  believed 
were  the  best  hospital  areas.  Retirees  identified  the  Emergency  Room,  13  of 
41  =  39%,  and  Inpatient  Care,  15  of  41  =  36.6%  as  the  hospital's  best  areas. 
The  Internal  Medicine  Clinic  and  Surgery  Clinic  were  identified  by  9  of  41  = 
22%  of  the  retirees  as  a  best  performance  area.  In  all  probability  this 
reflects  the  areas  most  used  by  retirees  and  their  dependents. 

Unit  commanders  identified  the  Acute  Minor  Illness  Clinic,  4  of  19  = 
21.1%;  the  Aviation  Medicine  Clinic,  4  of  19  =  21.1%;  and  Flight  Physicals, 

4  of  19  =  21.1%,  as  the  best  areas.  These  three  areas  are  where  the  unit 
commanders'  troops  receive  their  routine  health  care. 

In  comparing  the  patients'  best  performance  areas  and  most  identified 
problem  areas  it  may  be  said  that  the  patients  appear  satisfied  with  the 
direct  care  and  not  satisfied  with  some  of  the  structural  items  that  lead  to 
the  direct  ere  or  availability  of  care  as  shown  in  table  5. 


TABLE  5 


Comparison  of  Best  Performance  Areas  and 
Problem  Areas  Identified  by  Patients 


BEST  PERFORMANCE  AREAS 


PROBLEM  AREAS 


1. 

Pediatrics 

1.  More  Physicians  Needed 

2. 

Emergency  Room 

2.  Pharmacy 

3. 

Dental  Clinic 

3.  Improve  Staff  Attitude 

4. 

Inpatient  Care 

4.  Improve  Appointment  System 

5. 

Ophthalmology-^ 

5 .  Improve  AMIC-GMC 

Otolaryngology 

6.  Improve  Pediatrics 

6. 

Gynecology 

First  Questionnaire  Results  -  Staff 

The  initial  staff  questionnaire  had  an  overall  response  of  72  of  406  = 
17.7%.  The  staff  identified  63  separate  problems.  The  staff  participated 
at  the  following  levels:  Physicians,  4  of  28  =  14.3%;  Nurses,  10  of  49  = 
18.4%;  Administrators,  4  of  11  =  36.4%;  Ancillary,  15  of  73  =  20.5%; 
Paramedical,  14  of  89  =  15.7%;  and  Clerical,  25  of  156  =  16%. 

The  problems  were  grouped  into  general  problem  areas.  Unlike  the 
patient  problems  that  fell  into  specific  clinic  or  service  areas,  the  staff 
problems  fell  into  general  areas  that  affected  more  than  one  service  or 
clinic.  Some  problems  fell  under  general  headings  such  as  staff  patient 
relations  or  personnel  shortages.  Table  6  displays  the  problems  by  staff 
group  and  general  or  specific  area. 

Problems  chosen  for  ranking  were  those  specific  problems  identified  by 
approximately  10  percent  or  more  of  the  responses.  These  problems  were: 

Have  a  Walk-in  Clinic,  16  of  72  =  22.2%;  Improve  Patient  Staff  Relations,  15 
of  72  =  20.8%;  Physician  Shortage,  11  of  72  =  15.3%;  Stop  Abuse  of  the 
Emergency  Room,  7  of  72  =  9.7%;  Have  an  Evening  Pediatric  Clinic,  7  of  72  = 
9.7%;  and  Reduce  Pharmacy  Waiting  Time,  7  of  72  =  9.7%. 

The  reason  for  selecting  specifically  identified  problems  in  place  of 
the  general  problem  areas  was  two-fold.  First,  problems  identified  by  the 
staff  did  not  fit  into  clinic  or  service  groupings  like  the  patient  identi¬ 
fied  problems.  Second,  the  general  problem  areas  were  very  broad  cate¬ 
gories.  Identifying  personnel  shortages  or  physical  plant  improvements  as  a 
high  priority  problem  does  not  tell  the  hospital's  QA  committee  specific 
areas  to  make  improvements.  Thus,  the  ranking  of  specific  problems  would  be 
more  beneficial  to  discovering  cause  of  general  problems. 
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An  initial  analysis  of  the  results  showed  that  the  majority  of  the 
problems  identified  by  the  staff  (34  of  63)  were  centered  in  three  related 
areas.  These  were:  personnel  shortages,  patient-staff  relations,  and 
improving  access  to  care.  Five  of  the  six  problems  for  prioritization  came 
from  these  three  areas.  Two  areas,  patient  staff  relations  and  improve 
access  to  care,  were  mentioned  by  almost  everyone  who  answered  the  question¬ 
naire  (70  of  72).  These  two  areas  are  closely  related.  A  disruption  in 
health  care  services  whether  expected  or  not  can  cause  patient  hostility. 

The  patient  takes  his  frustration  out  on  the  clerical,  paramedical,  and 
ancillary  staff.  The  staff  perceives  that  if  access  is  improved  and  if  the 
patient  is  made  more  aware  of  the  staff's  problems,  then  health  care  percep¬ 
tions  will  be  improved.  The  staff  sees  a  specific  solution  as  having  a 
walk-in  clinic  and  increasing  the  physician  staffing.  The  staff  appears  to 
believe  the  fewer  people  who  are  refused  care  for  any  reason  will  make  their 
jobs  much  easier. 

The  physicians  did  not  perceive  any  patient-staff  relations  or  access 
problems.  This  may  not  be  concluded  for  all  hospital  physicians  since  only 
four  of  twenty-eight  responded.  Nevertheless,  those  physicians  did  not  see 
the  problems.  Perhaps  the  physician  and  patient  do  not  discuss  access  or 
appointment  problems  but  concentrate  on  the  health  encounter.  Perhaps  it  is 
not  encouraged  or  is  discouraged.  If  the  four  physicians  do  represent  the 
perceptions  of  the  other  physicians,  then  the  physician  staff  requires  some 
education  into  access  and  patient  relation  problems  so  potential  solutions 
can  be  discussed. 


If  one  looks  at  the  problems  from  a  quality  assurance  perspective  of 
structure,  process,  and  outcome,  an  interesting  result  is  observed.  None  of 
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the  identified  problems  are  outcome  related.  That  is,  none  of  the  problems 
have  to  do  with  measuring  the  patients'  health.  The  staff  believes  the  best 
care  is  being  provided.  Only  establishing  an  IV  team  and  establishing  a 
metabolic  support  team  can  be  called  process  problems.  These  problems 
address  the  method  in  which  the  health  care  is  performed  on  the  patient. 

The  other  sixty  problems  are  all  structure  problems  and  thus,  should  be  able 
to  be  corrected  with  the  addition  of  funds,  personnel,  equipment,  or  a 
change  in  operating  policy.  It  is  interesting  that  the  staff  who  delivers 
health  care  finds  no  fault  with  the  process  of  administering  care  but  does 
find  fault  with  the  structure  and  surroundings  in  which  the  care  is  delivered. 
The  staff  must  consider  themselves  performing  their  hands-on  health  care 
role  in  an  outstanding  manner  but  are  hindered  by  structure  problems.  They 
find  little  fault  with  themselves. 

Another  general  area  for  comparison  is  inpatient  versus  outpatient 
problems.  The  staff  identified  only  one  inpatient  problem  (1  of  63).  These 
pertained  to  the  food  service  tray  system.  Both  people  who  identify  this 
problem  work  in  food  service  and  think  the  current  tray  system  is  not  as 
good  as  the  old  cart  system. 

Both  the  patients  and  staff  have  identified  the  need  for  more  physi¬ 
cians,  improving  patient  staff  relations,  and  improving  the  pharmacy.  See 
table  7.  The  areas  of  the  appointment  system,  having  a  walk-in  clinic,  stop 
abuse  of  the  emergency  room,  and  have  an  evening  pediatric  clinic  all  have 
to  do  with  access  to  care  when  demanded.  Considering  these  areas  to  be  in 
agreement,  the  only  areas  differing  between  the  patients  and  staff  are  the 
AMIC-GMC  and  pediatric  clinic.  This  would  indicate  that  the  staff  and 
patients  have  a  similar  perspective  as  to  the  problems  in  the  hospital  and 
are  both  good  sources  for  problem  identification. 
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TABLE  7 

Problem  Identification  Comparison 
Between  Patients  and  Staff 


Patients 

Staff 

1. 

Need  More  Physicians 

1. 

Have  a  Walk-in  Clinic 

2. 

Improve  Pharmacy 

2. 

Improve  Patient-Staff  Relations 

3. 

Improve  Staff  Attitude 

3. 

Need  More  Physicians 

4. 

Improve  Appointment  System 

4. 

Stop  Abuse  of  the  ER 

5. 

Improve  AMIC-GMC 

5. 

Reduce  Pharmacy  Waiting  Time 

6. 

Improve  Pediatrics 

6. 

Have  an  Evening  Pediatric  Clinic 

Statistical  Considerations  and  Analysis-Problem  Prioritization 

The  second  questionnaire  asked  patients  to  prioritize  specific  problems. 
The  staff  was  asked  to  do  likewise  in  group  discussions.  The  data  was 
analyzed  and  is  presented  in  individual  tables  for  discussion.  Only  the 
first  table  will  be  discussed  in  detail.  The  tables  will  list  the  problems 
and  their  Rj  totals.  Statistical  test  results  will  be  below  the  rankings. 

These  are  the  Kendall  Coeficient  of  the  Concordance  (W),  the  coeficient's 

2  2 
significance  (X  ),  the  Friedman  two-way  analysis  of  variance  (Xr  ),  and  the 

multiple  comparison  of  Rj  totals  (Rjs).  Refer  back  to  the  introduction  and 

to  appendix  M  for  statistical  explanation. 

Initially,  the  patient  responses  as  a  group  will  be  analyzed.  Next, 

each  group  will  be  examined  for  rankings  of  general  and  specific  problems. 

The  staff  will  be  examined  as  a  whole  and  then  individually  analyzed  by 

group.  A  summary  of  the  significant  findings  will  be  last. 

Problem  Prioritization  -  Patients 

A  second  questionnaire  was  developed  for  patients.  The  questionnaire 
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asked  the  patients  to  prioritize  two  separate  lists.  The  first  list  was  the 
problems  most  identified  by  the  specific  patient  group.  The  second  list  was 
the  problems  most  identified  by  all  patients.  For  clarity,  the  first  list 
will  be  referred  to  as  the  specific  list  and  the  second  list  as  the  general 
patient  problem  list. 

The  questionnaires  were  mailed  to  the  same  individuals  who  received  the 
initial  questionnaire.  The  response  time  was  three  weeks,  that  is,  no 
questionnaires  arrived  after  three  weeks  from  mailing.  The  response  rate 
was  as  follows:  active  duty,  43  of  150  =  28.7%;  dependents  of  active 
duty,  45  of  150  =  30%;  retirees  and  their  dependents,  59  of  150  =  39.3%; 
and  unit  commanders,  32  of  38  =  84.2%.  The  group  return  rate  for  patients 
(less  unit  commanders)  was  32.7%. 


TABLE  8 

Total  Patient  Ranking 
of  General  Patient  Problems 


Problem 

R.1  Toti 

1.  Need  More  Physicians 

2.  Improve  Staff  Attitude  to 

305.2 

Patients 

477.2 

3.  Improve  Appointment  System 

477.7 

4.  Improve  Pharmacy 

513.2 

5.  Improve  Pediatrics 

567.2 

6.  Imporve  AMIC-GMC 

621.2 

Statistics 

Kendall  W 

.170 

X2 

120.11 

Xr2 

19.10 

Rjs 

92.05 

X2  and  Xr2  values  are  compared  to  a  chi  square  table  with 
df=5  and  the  value  for  =.005  Is  16.  T' 
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As  a  group,  the  patients  produced  a  Kendall  W  of  .170  with  the  probability 


of  the  association  occurring  by  chance  being  less  than  .005.  See  table  8. 

This  indicates  the  entire  group  did  not  use  the  same  criteria  to  evaluate 

the  problems,  but  there  was  enough  similarity  to  rule  out  the  ratings  occurring 

2 

by  chance  at  p  <  .005.  The  Xr  indicates  a  preference  for  one  problem  over 
another  with  the  chance  of  the  Rj  totals  occurring  by  chance  at  p  <  .005. 

This  means  the  Rj  totals  (sum  of  problem  rankings  by  individual)  were  different 
enough  to  state  the  group  had  a  preference.  The  Rjs  value,  92.05,  indicates 
the  significantly  important  problem's  numerical  difference  at  p  <  .05.  This 
group  identified  the  need  for  more  physicians  as  significantly  more  important 
than  any  other  problem  (305.2  +  92.05  =  397.25).  Likewise,  improving  the 
AMIC-GMC  is  significantly  less  important  than  the  need  for  physicians,  staff 
attitudes,  the  appointment  system,  and  the  pharmacy.  The  appointment  system 
and  staff  attitude  were  significantly  more  important  than  the  pharmacy  at  p 
=  .069.  This  places  the  problems  in  four  groups:  physicians,  attitude  and 
appointment  system,  pharmacy,  and  pediatrics  and  AMIC-GMC.  In  general, 
patients  perceive  a  shortage  of  medical  care,  access  to  care,  and  impersonal 
treatment  by  the  staff  as  the  hospital's  major  problems.  These  problem 
areas  relate  to  quality  assurance  structure  rather  than  process  or  outcome. 
Areas  with  the  potential  for  process  problems  are  ranked  at  the  bottom. 

This  indicates  an  acceptance  with  the  health  care  provided  but  not  with  the 
surroundings  or  availability.  See  table  9  for  a  summary  of  significant 
patient  problems  by  Rj  comparison. 

Each  patient  group,  active  duty,  active  duty  dependents,  and  retirees 
and  their  dependents  will  have  their  responses  analyzed.  Comparisons  will 
be  made  between  the  individual  groups  and  the  patients'  combined  group. 
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TABLE  9 

Significant  R  Differences  Among  Problems  Ranked  by  Patients 


PROBLEM 


STAFF  GROUP 


1  2  3 

Appointment  Improve  Need 
System  AMIC-  More 


4  5  6 

Improve  Improve  Improve 
Pediatric  Pharmacy  Staff 


Physicians  Clinic 


Attitude 


Active  Duty 


Dependents  of 
Active  Duty 


1,2,5 


Retirees  and 

Their  Dependents  2,4 


1,2, 4, 5, 6 


All  Patients 


2,4,5 


Interpretation  of  chart  is  as  follows:  Active  duty  personnel  think 
problem  1  is  significantly  more  important  than  problem  2,  problem  3  is  significantly 
more  important  than  problems  2  and  5,  problem  4  is  significantly  more  important  than 
problem  2  and  problem  6  is  significantly  more  important  than  problem  2.  (p=.05) 


TABLE  10. 


Active  Duty  Ranking 
of  General  Patient  Problems 


Problem 

R.1  Total 

1.  Need  More  Physicians 

104.2 

2.  Improve  Appointment  System 

135.2 

3.  Improve  Pediatrics 

4.  Improve  Staff  Attitude  to 

139.2 

Patients 

141.2 

5.  Improve  Pharmacy 

171.2 

6.  Improve  AMIC-GMC 

195.2 

Statistics 

Kendall  W 

.166 

_2 

X 

34.91 

Xr2 

42.00 

Rjs. 

50..  24 

X2  and  Xr2  values  are  compared  to  a  chi  square  table  with 
df«5  and  the  value  for  <X.  =.005  is  16.75. 


The  data  in  table  10  shows  the  association  not  being  strong,  W  =  .166, 
but  the  problems  being  significantly  different.  The  soldier  preferences  are 
similar  to  the  patient  group  with  a  switch  between  pediatrics  and  pharmacy. 

Although  the  Kendall  is  low  the  association  and  Rj  total  differences 
are  significant  in  ranking  specific  problems.  See  table  11.  The  low  associa 
tions  may  be  expected  among  soldiers  because  their  ages,  sex,  and  rank  build 
in  different  perceptions  in  addition  to  their  individual  personalities.  The 
high  placement  of  the  emergency  room  indicates  an  access  problem,  similar  to 
the  all  patients  list. 


TABLE  11 


Active  Duty  Ranking 


of  Active  Duty  Specific 

Probl eras 

Problem 

Ri  Total 

1.  Improve  Emergency  Room 

82.5 

2.  Improve  Appointment  System 

3.  Improve  Staff  Attitude  to 

107.0 

Patients 

109.0 

4.  Improve  Pharmacy 

131.5 

Statistics 

Kendall  W 

.135 

X2 

17.42 

Xr2 

148.  79 

Rjs 

31.55 

X2  and  Xr^  values  are  compared  to  a  chi  square  table  with 
df=3  and  the  value  for  of  =.005  is  12.83. 


The  Kendall  indicates  the  dependents  of  active  duty  did  not  use  the 


same  criteria  to  judge  the  problems  but  the  judgments  were  significantly 
different.  See  table  12.  Again,  the  need  for  physicians  is  significantly 

greater  than  any  problem  but  pediatrics  and  staff  attitude.  Pediatrics 

l 

■  holds  a  higher  position  with  this  group  than  the  all  patients  list.  No 
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doubt,  this  is  a  result  of  the  high  pediatrics  use  by  this  group. 

The  dependents  of  active  duty  specific  list  is  very  similar  to  the 
general  patient  problem  list,  the  emergency  room  is  in  place  of  the  appoint 
ment  system.  See  table  13.  This  association  and  significance  was  similar 
to  the  general  patient  problem  ist.  The  emergency  room  is  placed  high  on 
the  list.  This  is  a  main  health  care  entry  point  for  dependents  but  is 
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significantly  more  important  than  the  other  entry  point,  AMIC-GMC.  The 
emergency  room  is  a  primary  entry  point  on  weekends  and  after  duty  hours  and 
when  appointments  are  full  at  AMIC-GMC  and  Pediatrics.  There  is  a  high 
potential  for  problems  because  people  expect  instant  care  for  emergencies 
and  are  frustrated  at  using  the  emergency  room  because  appointments  are 
full . 


TABLE  12 


Dependents  of  Active  Duty  Ranking 
of  General  Patient  Problems 


Problem 

Rl  Total 

1. 

Need  More  Physicians 

107 

2. 

Improve  Staff  Attitude  to 

Patients 

146 

3. 

Improve  Pediatrics 

151 

A. 

Improve  Pharmacy 

168 

5. 

Improve  Appointment  System 

175 

6. 

Improve  AMIC-GMC 

198 

Statistics 


Kendall  W 


Xr2 

Rja 


.131 
30.38 
30. 42 
52.0 


2  2 

X*  and  Xr*  values  are  compared  to  a  chi  square  table  with 
df=5  and  the  value  at<X=.O05  is  16.75. 
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TABLE  13 

Dependents  of  Active  Duty  Ranking 
of  Specific  Problems 


Problem 

Ri  Total 

1.  Need  More  Physicians 

107 

2.  Improve  Emergency  Room 

148 

3.  Improve  Pediatrics 

4.  Improve  Staff  Attitude  to 

162 

Patients 

162 

5.  Improve  Pharmacy 

165 

6.  Improve  AMIC-GMC 

201 

Statistics 

Kendall  W 

.  131 

X2 

29.48 

Xr2 

39.39 

Rjs 

52.0 

X2  and  Xr2  values  are  compared  to  a  chi  square  table  with 
df=5  and  the  value  atd>-.005  is  16.75. 


The  retirees  show  the  strongest  association  of  any  patient  group.  See 
table  14.  This  indicates  their  criteria  for  judging  the  problems  is  most 
similar  of  the  patient  groups.  The  differences  among  the  problems  are 
significant.  The  physician  shortage  is  the  most  significant  problem,  more 
than  any  other.  They  find  access  to  care  a  problem,  though  the  appointment 
system  is  significantly  more  important  than  improving  the  clinic  where  the  care 
is  rendered.  One  may  conclude  the  care  is  acceptable  but  access  is  not. 

The  pharmacy  is  higher  on  the  retirees'  list  than  the  all  patients  list. 

The  retirees  use  the  pharmacy  more  for  refill  drugs  and  civilian  prescriptions; 
thus,  have  a  greater  chance  for  dissatisfaction  because  of  exposure  frequency. 
The  reverse  can  be  assumed  for  pediatric's  low  priority. 


TABLE  14 


Retirees  and  Theif  Dependents  Ranking 
of  General  Patient  Problems 


Problem 

R.i  Total 

1.  Need  More  Physicians 

94 

2.  Improve  Appointment  System 

165.5 

3.  Improve  Pharmacy 

4.  Improve  Staff  Attitide  to 

176.0 

Patients 

193.5 

5.  Improve  AMIC-GMC 

230 

6.  Improve  Pediatrics 

275 

Statistics 

Kendall  W 

.379 

X2 

102.33 

Xr2 

101.80 

Rjs 

56.97 

X2  and  Xr2  values  are  compared  to  a  chi  square  table  with 
df=5  and  the  value  ato<=,005  is.  16.75. 


Probably,  the  lower  retiree  W  is  caused  by  the  retiree  using  a  narrow, 
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personal  view  of  the  specific  problems.  See  table  15.  The  Xr  value  indicates 
no  significant  differences  between  the  Rj  totals.  Thus,  the  middle  five 
problems  are  about  the  same  and  no  conclusion  about  their  individual  importance 
may  be  drawn.  The  Rjs  statistic  does  allow  the  conclusion  that  the  physician 
shortage  is  more  significant  than  any  other  problem  and  GYN  is  less  significant 
than  the  first  five. 


TABLE  15 


Retirees  and  Their  Dependents  Ranking 
of  Specific  Problems 


Problem 

R1  Total 

1. 

Need  More  Physicians 

140.7 

2. 

Provide  Physical  Exams  to 

Retirees 

222.2 

3. 

Improve  Dental  Care 

222.7 

4. 

Improve  Appointment  System 

224.2 

5. 

Improve  Pharmacy 

225.0 

6. 

Improve  EENT  Clinic 

231.5 

7. 

Improve  GYN  Clinic 

295.7 

Statistics 

Kendall  W 

.207 

X2 

61.07 

Xr2 

-110.0 

Rjs 

70.63 

X 2  and  Xr^  values  are  compared  to  a  chi  square  table  with 
df=6  and  the  value  at  «(  =.005  is  18.54. 


Problems  ranked  by  the  retiree  council  use  are  at  table  16.  The  retiree 
council,  a  group  of  14  retired  officers  and  enlisted  men,  was  addressed  on 
the  hospital's  attempt  to  develop  a  prioritized  problem  list.  The  retiree 
specific  problem  list  was  presented  to  the  council  during  their  quarterly 
meeting.  They  were  asked  to  prioritize  the  seven  identified  retiree  problems 
Their  prioritization  would  be  compared  to  the  retirees. 

The  W  value  indicates  the  council  is  basing  its  rankings  on  similar 


criteria.  The  group  has  a  preference  for  one  problem  over  another. 


TABLE  16 


Retiree  Council  Ranking  of 
Retiree  Specific  Problems 


Problem 

R1  Total 

1. 

Need  More  Physicians 

22.5 

2. 

Improve  Appointment  System 

32.5 

3. 

Improve  Dental  Care 

49.5 

4. 

Provide  Physical  Exams  to 

Retirees 

62.0 

5. 

Improve  EENT  Clinic 

65.5 

6. 

Improve  Pharmacy 

68.0 

7. 

Improve  GYN  Clinic 

87.0 

Statistics 

Kendall  W 


.548 


X 


2 


36.55 


Xr2 


36.40 


Rjs  24.41 

X2  and  Xr2  values  are  compared  to  a  chi  square  table  with 
df-6  and  the  value  at«(  “.005  is  18.54. 


Unlike  the  retirees  and  their  dependents,  the  council  was  able  to  prioritize 

problems  with  a  specific  order.  This  is  very  helpful  to  the  hospital  when 

all  problems  cannot  be  studied  at  one  time.  See  table  17  for  a  comparison 

of  the  two  groups.  To  evaluate  if  the  retirees  and  retiree  council  perceive 

problems  imilarly,  a  W  test  was  performed  using  the  problem  order  as  rankings 

and  the  two  groups  as  judges.  The  W  value  was  .910  but  the  probability  of 
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the  association  occurring  by  chance  was  .05  <  p  <  .1.  The  Xr  value  was 
significant  between  .05  <  p  <  .1.  The  association  is  high  but  the  significance 


TABLE  17 


Comparison  Between  Retirees  and 
Retiree  Council  Ranking  Retiree  Specific  Problems 


RETIREES  RETIREE  COUNCIL 


1. 

Need  More  Physicians 

1. 

Need  More  Physicians 

2. 

Physical  Exams  for 

2. 

Improve  Appointment  System 

Retirees 

3. 

Improve  Dental  Care 

3. 

Improve  Dental  Care 

4. 

Physical  Exams  for 

4. 

Improve  Appointment 

Retirees 

System 

5. 

Improve  EENT  Clinic 

5. 

Improve  Pharmacy 

6. 

Improve  Pharmacy 

6. 

7. 

Improve  EENT  Clinic 
Improve  GYN  Clinic 

7. 

Improve  GYN  Clinic 

is  not  equally  high  because  only  two  judges  were  used. 

It  could  be  concluded  that  the  retirees  and  retiree  council  rank  problems 
similarly  using  approximately  the  same  criteria  and  perceive  like  differences 
in  problems.  This  conclusion  could  save  considerable  time  allowing  the 
council  to  speak  for  retirees.  The  risk  would  be  making  a  type  I  error, 
assuming  the  retirees  and  council  perceived  the  same  when  they  did  not. 
Problems  would  not  be  satisfactorily  evaluated  under  this  error.  Prior  to 
using  the  retiree  council  exclusively,  more  comparisons  should  be  made 
between  the  council  and  retiree  population  on  different  health  care  matters. 

The  commanders  did  not  use  similar  criteria  to  judge  the  problems.  See 
table  18.  This  was  not  as  believed  because  commanders  are  supposed  to  have 
similar  problems.  Evidently,  this  is  not  the  case  with  health  care. 


TABLE  18 


Commander's  Ranking 
of  Commander  Specific  Problems 


Problem  Rj  Total 


1.  Improve  Staff  Attitude  to 

Patients 

67 

2.  Improve  Profile  4  Quarters 
Limitation  Instructions 

73 

3.  Iraitiate  OB  Service 

86 

4.  Improve  Pharmacy 

94 

Statistics 

Kendall  W 

.088 

X2 

8.45 

Xr2 

9.74 

Rjs 

27.21 

X2  is  compared  to  a  chi  square  table  with  df=3  and  the  value 
8.45  equal  to  an  c(  of  .034. 

Xr2 ' is  compared  to  a  chi  square  table  with  df =3  and  the  value 
9.74  equal  to  an  a  of  .025. 


There  was  significant  difference  between  the  first  and  last  problem  at  p  = 
.054.  There  was  not  as  strong  a  significant  difference  between  Rjs  as 
imagined.  Apparently,  the  myth,  all  commanders  are  the  same,  is  just  that, 
a  myth.  The  commanders'1  first  priority  problem,  attitude,  probably  comes 
from  the  hospital'ls  insensitivity  to  their  problems  related  to  health  care. 

Table  13  recaps  the  patient  problems  ranking.  Taking  into  consideration 
the  different  groups  some  problems  are  highlighted.  Both  active  duty  and 
dependents  of  active  duty  assigned  a  high  priority  to  improving  the  emergency 
room.  In  the  specific  problem  lists  for  each  group,  the  active  duty  list 
had  the  emergency  room  ranked  first  and  the  dependent  specific  list  had  it 
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TABLE  19 

General  Patient  Problems  as  Ranked  by 
Active  Duty,  Dependents  of  Active  Duty,  and  Retirees  and  Their  Dependents 


Problem  Rj  Total 


1. 

Heed  More  Physicians 

305.2 

2. 

Improve  Staff  Attitude  to 

Patients 

477.2 

3. 

Improve  Appointment  System 

477.7 

9. 

Improve  Pharmacy 

513.2 

5. 

Improve  Pediatrics 

567.2 

6. 

Improve  AMIC-GMC 

621.2 

Rjs  Value  is  92.05 


as  second,  behind  needing  more  physicians.  This  would  indicate  that  improving 
emergency  room  services  could  improve  the  active  duty  and  dependent  of 
active  duty's  perception  of  health  care.  It  must  be  remembered  that  this 
area  is  a  high  use  area  after  duty  hours  and  weekends.  It  has  a  great 
potential  for  dissatisfaction  as  patients  expect  quick  and  sympathetic 
service  at  a  location  that  is  staffed  to  treat  life-threatening  emergencies. 
This  area  would  be  mentioned  as  a  specific  patient  group  problem. 

Problem  Prioritization  -  Staff 

The  staff  was  asked  to  prioritize  problems  in  group  discussions  conducted 
as  modified  nominal  groups.  The  staff  groups  were  the  same  as  the  initial 
survey.  The  number  of  discussions  held  by  group,  the  number  of  participants, 
and  the  percentage  of  the  group  participating  follows.  There  was  one  group 
of  twelve  physicians,  42%.  There  was  one  group  of  eight  administrators, 

72.7%.  There  were  two  groups,  five  each  of  ancillary  personnel,  13.7%. 

There  were  three  groups,  five  each  of  registered  nurses,  30.6%.  There  were 
four  groups,  five  per  group,  of  clerical  personnel,  12.8%.  Overall,  there  were 


eighty-six  personnel  participating  in  the  group  discussions  or  21.2%  of  the 
staff.  The  discussions  were  structured  around  an  explanation  of  what  the 
quality  assurance  program  was,  the  problem  orientation  of  the  program,  and 
how  the  group  discussion  would  assist  with  problem  prioritization.  All 
groups  participated  with  enthusiasm  except  the  physicians.  The  physicians 
were  interested  in  discussing  hospital  problems,  their  causes  and  solutions, 
but  were  not  interested  in  prioritizing  the  problems  identified  by  the 
staff.  A  summary  of  the  physician  conference  is  at  the  end  of  this  section. 

The  staff  uses  similar  criteria  to  judge  problems.  See  table  20.  There 
are  significant  differences  between  the  problems  in  the  staffs  judgment. 


TABLE  20 

Staff  Ranking  of  Hospital  Problems 


Problem 

R.1  Total 

1. 

Reduce  MD  Shortage 

135 

2. 

Improve  Patient-Staff 

Relations 

187 

3. 

Have  a  Walk-in  Clinic 

277 

4. 

Reduce  Pharmacy  Waiting  Time 

292 

5. 

Stop  Abuse  of  the  ER 

297 

6. 

Have  an  Evening  Pediatric 

Clinic 

346 

Statistics 

Kendall  W 

.332 

X2 

122.65 

Xr2 

79.63 

Rjs 

67.13 

X2  and  xf  values  are  compared  to  a  chi  square  table  with 
df“5  and  the  value  at<X  =  .005  is  16.75. 
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Specifically  the  physician  shortage  and  patient-staff  relations  problems  are 
significantly  different  than  the  other  problems.  This  indicates  a  strong 
preference  to  increase  services  and  improve  the  patient-hospital  contact. 
Having  a  walk-in  clinic  is  significantly  more  important  than  having  an 
evening  pediatric  clinic,  yet  both  problems  deal  with  access.  The  staff 
perceives  pediatrics  access  acceptable  when  compared  to  the  general  adult 
population.  Table  21  illustrates  the  significantly  important  problems  by 
staff  and  individual  staff  group. 


TABLE  2 1 


Significant  Rj  Differences  Among  Problems  Ranked  by  Hospital  Staff 


PROBLEM 


STAFF  CROUP 


Hurscs 


Administration 

Ancillary 

Paramedical 

Clerical 

'Staff  as  a 
Whole 


.1  ‘  2  •  /  3  •’  4  '5  !  6 

Evening  Have  a  Improve  Reduce  Reduce  Stop 

Pediatric  Walk-in  Patient  Physician  Pharmacy  ER 

Clinic  Clinic  Relations  Shortage  Waiting  Abuse 


2  1,2, 5,6 
1,5,6  1,2, 5, 6 
1  1,2, 5, 6 


1,2, 5, 6  1,2, 5, 6 


Interpretation  of  the  chart  is  as  follows:  Nurses  find  problem  4 
significantly  more  important  at  a  p“.05  level  than  problems  1  and  5. 


TABLE  22 


Nurses  Ranking  of  Hospital  Problems 


Problem 

R1  Total 

1.  Reduce  MD  Shortage 

28 

2.  Have  a  Walk-in  Clinic 

53 

3.  Improve  Patient-Staff 
Relations 

53 

4.  Stop  Abuse  of  the  ER 

55 

5.  Have  an  Evening  Pediatric 
Clinic 

63 

6.  Reduce  Fharmacy  Waiting  Time 

63 

Statistics 

Kendall  W 

.210 

X2 

827.5 

Xr2 

15.0 

Rjs 

30.02 

X2  Is  calculated  from  the  s  value  (see  Appendix  M)  and  compared 
to  a  chart  in  Siegel,  p.  286.  Thec(=.01  value  is  758.2.  Any  s 

value  less  than  this  has  a  greater  than  .01  probability  of  occuring 
by  chance  with  the  number  of  judges  involved. 

Xr2  is  compared  to  a  chi  square  table  with  df=5  and  art  ".005  value 

of  16.75. 
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The  nursesJ  priorities  are  in  close  alignment  with  the  staff's.  See 
table  22.  The  W  is  less  than  the  staff  which  indicates  less  agreement  in 
judgment  criteria.  The  possibility  the  judgment  Rj  totals  are  significantly 
different  is  between  .01  <  p  <  .05.  Thus,  the  nurses'  difference  in  problem 
priority  is  not  as  strong  as  administrators,  ancillary,  or  paramedics.  This 
may  be  traced  to  the  traditional  division  of  nursing  priorities  between 
clerical  and  administrative  duties.  The  nurses  place  increasing  access, 
through  more  physicians  and  having  a  walk-in  clinic,  ahead  of  improving 
relations,  although  not  significantly-  This  reflects  a  clinical,  patient 
contact  orientation. 

The  administrators  had  a  Kendall  W  of  .416  which  would  indicate  a  stronger 
degree  of  association  than  the  staff.  See  table  23.  This  suggests  that 


TABLE  23 

Administrators  Ranking  of  Hospital  Problems 


Problem 

R.i  Total 

1.  Improve  Patient-Staff 

Relations 

12 

2.  Have  a  Walk-in  Clinic 

26 

3.  Reduce  Physician  Shortage 

27 

4.  Reduce  Pharmacy  Waiting  Time 

5.  Have  an  Evening  Pediatric 

28 

Clinic 

34 

0.  Stop  Abuse  of  the  ER 

41 

Statistics 

Kendall  W 

.416 

X2 

466 

Xr2 

16.64 

Rja 

21.93 

X  is  calculated  from  the  s  value.  See  explanation  on  Table 
22.  Critical  value  is  442. 

Xr2  is  compared  to  a  chi  square  table  with  df~5  and  a  o(  =.005 
value  of  16. 75. 


administrators  share  a  common  set  of  criteria  in  judging  hospital  problems. 

The  administrators  saw  the  patient-staff  relations  as  being  signi ficantly 
more  important  than  the  evening  pediatric  clinic  or  abuse  of  the  emergency 
room.  The  administrators  varied  from  the  staff  ranking  by  placing  improvement 
of  patient  staff  relations  and  having  a  walk-in  clinic  ahead  of  the  physician 
shortage.  The  administrators'  orientation  to  relations  and  access  stems 
from  being  the  focal  point  for  answering  patient  complaints  about  the  two 
problems.  Their  reality  is  no  new  physicians  will  be  assigned  until  summer 
1981,  thus,  work  on  those  areas  that  can  be  improved.  Human  relations 
emphasis  and  changing  the  obstructive  appointment  system  can  reduce  the 
administrators'  complaint  frequency.  What  is  not  considered  by  the  administra¬ 
tor  is  the  time  required  to  treat  the  patient  demand  and  its  effect  on 
physician  effectiveness  and  morale. 

The  ancillary  personnel  had  a  Kendall  W  of  .578  which  is  the  strongest 
degree  of  association  among  the  staff  groups.  See  taDle  24. 

Ancillary  personnel  differed  from  the  staff  in  having  a  walk-in  clinic. 
This  problem  was  the  last  priority  for  ancillary  personnel.  The  conceivable 
reason  is  a  walk-in  clinic  will  increase  outpatient  care  which  in  turn  will 
increase  the  need  for  ancillary  services.  The  ancillary  personnels’  perception 
is  that  they  are  already  overworked. 
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TABLE  24 

Ancillary  Personnel  Ranking  of  Hospital  Problems 


Problem 

Ri  Total 

1.  Reduce  MI)  Shortage 

2.  Improve  Patient-Staff 

13 

Relations 

23 

3.  Stop  Abuse  of  the  F.R 

38 

A.  Reduce  Pharmacy  Waiting  Time 
5.  Have  an  Evening  Pediatric 

42 

Clinic 

45 

6.  Have  a  Walk-in  Clinic 

50 

Statistics 

Kendall  W 

.578 

X2 

1010.80 

Xr2 

30.88 

Rj  s 

24.51 

is  calculated  from  the  s  value.  Sc"  -xplal nation  on  Table  22. 
Critical  value  is  494. 

2 

Xr  is  compared  to  a  chi  square  table  with  dl  =  5  and  art =.005 
value  of  16. 75. 


The  paramedics'  Kendall  is  .554.  See  table  25.  This  may  appear  high 
considering  the  diverse  assignments  (licensed  practical  nurses,  emergency 
medical  technicians,  and  nursing  assistants)  and  that  both  .ilitary  and 
civilian  personnel  occupy  the  positions.  vet,  these  individuals  are  usually 
the  first  hospital  personnel  a  patient  contacts  in  a  clinical  setting. 

Thus,  these  personnel  receive  the  patients'  initial  reaction  to  any  unmet 
pe-ception  and  should  have  a  good  idea  of  patient  problems.  Their  rankings 
match  the  staff  as  a  whole. 
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TABLE  25 

Paramedical  Personnel  Rankings 
of  Hospital  Problems 


Problem 

Ri  Total 

1. 

Reduce  MD  Shortage 

31 

2. 

Improve  Patient-Staff 

Relations 

46 

3. 

Have  a  Walk-in  Clinic 

69 

4. 

Reduce  Pharmacy  Waiting  Time 

83 

5. 

Stop  Abuse  of  the  ER 

83 

6. 

Have  an  Evening  Pediatric 

Clinic 

108 

Statistics 

Kendall  W  .554 

X2  3880.0 

Xr2  55.46 

Rjs  35.52 

X2  is  calculated  from  the  s  value.  See  explaination  on  Table  22 
Critical  value  is  1022.2. 

Xr2  is  compared  to  a  chi  square  tabic  with  df=5  and  ad  =.005 
value  of  16.75. 
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TABLE  26 

Clerical  Staff  Rankings  of  Hospital  Problems 


Problem 

Rj  Total 

1. 

Reduce  11D  Shortage 

36 

2. 

Improve  Patient-Staff 

Relations 

54 

3. 

Reduce  Pharmacy  Waiting  Time 

73 

4. 

Have  a  Walk-in  Clinic 

82 

5. 

Stop  Abuse  of  the  ER 

83 

6. 

Have  an  Evening  Pediatric 

Clinic 

92 

Statistics 


Kendall  W 


X 


2 


.317 

2218.0 


Xr2 


-10.82 


Rjs  34.67 

2 

X  is  calculated  from  the  s  value.  See  explanation  on  Table  22. 
Critical  value  is  1022.2. 

Xr2  is  compared  to  a  chi  square,  table  with  df=5  and  a  d  =.005 
value  of  16. 75. 


The  clerical  personnel  have  a  W  almost  equal  to  the  staff  as  a  whole. 

See  table  26.  This  is  not  unusual  because  clerical  job  diversity  and  different 
degrees  of  patient  contact  are  as  diverse  as  the  staff.  Unlike  the  staff, 
the  clerical  employees  did  not  differ  significantly  in  the  preference  for 
the  problems.  This  may  be  attributed  to  their  diversity.  The  group  did 
express  a  significance  for  the  physician  shortage  over  the  last  four  problems 
and  improving  relations  over  an  evening  pediatric  clinic.  This  is  very 
similar  to  the  staff  as  a  whole. 


Summation  of  Physician  Conference 


The  writer  held  a  conference  with  twelve  physicians  to  discuss  quality 
assurance  and  prioritize  identified  problems.  The  conference  began  with  a 
presentation  about  the  history  of  quality  assurance,  Lyster  Hospital's 
quality  assurance  plan,  the  role  of  the  physician  in  quality  assurance,  and 
action  being  taken  on  a  current  problem,  nursing  service  personnel  performance 
during  cardiopulmonary  resuscitation.  Emphasis  was  placed  upon  the  impor¬ 
tance  of  problem  identification  and  prioritizing  the  identified  problems. 

The  physicians  were  briefed  on  the  staff  and  patient  survey  technique  and 
initial  results.  Like  other  staff  members,  they  were  asked  to  prioritize 
the  six  problem  areas  identified  in  the  staff  survey.  These  were:  have  an 
evening  pediatric  clinic;  have  a  walk-in  clinic;  improve  patient  staff 
relations;  reduce  the  physician  shortage;  reduce  pharmacy  waiting  time; 
and  stop  abuse  of  the  emergency  room.  The  group  dismissed  reducing  phar¬ 
macy  waiting  time  as  not  being  a  problem.  The  group  discussed  the  other 
five  areas  as  being  interrelated  and  almost  inseparable.  They  saw  the 
problem  as  patient  demand  versus  physician  supply  and  the  motivation  on  the 
part  of  the  patient  and  physician  in  the  system.  There  is  a  great  demand 
for  care  at  Lyster  Hospital.  Statistically,  there  are  approximately  200 
visits  a  day  to  the  Acute  Minor  Illness  Clinic  (AMIC)  and  90  visits  a  day  to 
the  Emergency  Room.  These  are  the  two  initial  entry  clinics  available  at 
Lyster  Hospital,  the  remaining  clinics  are  by  appointment  only.  One  physician 
staffs  the  Emergency  Room  and  five  physicians  staff  the  AMIC.  The  Emergency 
Room  is  never  closed  and  the  AMIC  is  open  Monday  through  Friday  from  0700 


hours  to  1 530  hours. 

The  physicians  did  not  consider  the  AMOSISTs  as  providers  but  advanced 


screeners.  The  majority  of  the  AMOSIST  evaluated  patients  end  up  requiring 
a  physician  according  to  the  group.  Supervising  the  AMOSISTs  and  reviewing 
their  work  was  thought  almost  more  trouble  than  it  was  worth.  Some  of  the 
physicians  would  like  to  see  the  program  dropped. 

The  physicians  desire  to  examine  every  patient  as  thoroughly  as  pos¬ 
sible  to  determine  the  required  treatment  or  further  evaluation  by  another 
physician.  This  takes  about  20  minutes  when  laboratory  or  radiology  studies 
are  required.  If  this  much  time  is  spent  with  each  patient,  then  there  is 
not  enough  time  during  the  day  to  see  all  the  patients  who  demand  health 
care.  Note  that  five  physicians  working  eight  hours  and  only  seeing  patients 
at  20-minute  intervals  can  see  120  patients  a  day.  This  is  eighty  patients 
short  of  200  patient  demand.  The  Emergency  Room  could  see  approximately 
seventy  patients  a  day  at  20-minutes  per  patient.  Thus,  the  physicians 
believe  that  they  must  spend  less  than  optimal  time  to  see  each  patient  or 
see  fewer  patients.  This  situation  is  aggravated  by  those  who  abuse  the 
system.  These  are  the  worried  well  and  nonemergency  or  nonurgent  patients 
who  inappropriately  use  the  hospital.  The  physicians  believe  that  keeping 
these  people  out  of  the  hospital  would  reduce  the  supply  and  demand  problem. 

The  patient  wants  as  much  of  the  physicianJs  time  as  possible  to  be 
reassured  that  treatment  is  complete  and  proper.  The  patient  expects  a 
short  waiting  time  to  see  the  physician.  But  there  is  more  patient  demand 
than  physician  supply.  Thus,  the  patient  waits  for  the  evening  or  weekend 
to  seek  care  because  the  demand  is  lower,  the  waiting  time  is  shorter,  and 
it  is  more  convenient. 

The  physicians  believe  there  is  little  motivation,  save  personal  pride 
and  professionalism,  for  treating  as  many  patients  as  possible.  Seeing  as 
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many  patients  as  rapidly  as  possible  in  the  Emergency  Room  will  only  aggra¬ 
vate  the  problem.  They  believe  that  the  shorter  the  waiting  time  is  in  the 
Emergency  Room,  the  more  people  will  use  it  because  it  is  faster  than  the 
AMIC.  If  the  physicians  work  too  slow  in  the  Emergency  Room  the  truly  sick 
patient  may  have  to  wait  for  treatment  which  could  have  severe  effects,  such 
as  bacterial  meningitis.  They  think  they  are  in  a  no  win  situation. 

In  summary,  the  physicians  believe  that  the  most  important  problem  is 
reducing  patient  demand.  By  accomplishing  this  reduction,  the  abuse  of  the 
Emergency  Room,  having  an  evening  pediatric  clinic,  having  a  walk-in  clinic 
and  reducing  the  physician  shortage  will  take  care  of  themselves.  These 
changes  will  improve  patient  staff  relations  by  making  care  more  available 
and  aligning  hospital  and  patient  expectations  about  care. 

Summation  of  Staff  Problems 

All  staff  groups  had  the  same  two  problems  of  physician  shortage  and 
improving  patient  staff  relations  as  significantly  different  from  the  other 
groups.  Interestingly,  only  the  administrators  perceived  improving  patient- 
staff  relations  as  the  most  important  problem.  While  all  the  other  groups 
felt  the  reducing  the  physician  shortage  was  the  most  important.  The  differ¬ 
ence  in  the  two  approaches  could  be  that  administrators  do  not  directly 
interact  with  patients  but  with  the  results  of  patient  complaints  about  the 
staff.  The  other  groups  meet  daily  with  the  patient  and  perceive  the  patient's 
problem  as  not  enough  care,  not  that  the  staff  does  not  interact  acceptably 
with  the  patients. 

The  staff  identifies  the  shortage  of  physicians  as  the  most  important 
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problem  facing  the  hospital.  The  next  most  important  problem  is  improving 
patient  staff  relations.  These  two  problems  show  significant  differences 
(p  <  .05)  to  all  other  problems  identified  in  most  cases.  The  problem  of  not 
having  a  walk-in  clinic  is  significantly  more  important  by  two  groups  than 
having  an  evening  pediatric  clinic:  The  walk-in  clinic  would  rank  below 
increasing  physicians  and  improving  relations.  The  problems  of  stopping 
abuse  of  the  emergency  room,  reducing  pharmacy  waiting  time,  and  having  an 
evening  pediatric  clinic  rate  below  the  other  three.  The  problems 
could  be  generally  classified  as  most  important:  reducing  the  physician 
shortage  and  improving  staff-patient  relations;  important:  having  a  walk- 
in  clinic;  and  not  as  important:  stop  abuse  of  the  emergency  room,  reduce 
pharmacy  waiting  time,  and  having  an  evening  pediatric  clinic. 

Inpatient  Questionnaire  Results 

The  staff  and  patient  questionnaires  identified  only  8  of  158  problems 
relating  to  inpatient  care.  This  low  rate  of  five  percent  reinforces  the 
need  to  separately  question  inpatients  concerning  their  care.  The  patients 
discharged  during  December  1980  were  mailed  a  questionnaire  concerning  their 
inpatient  stay.  Of  the  155  questionnaires  mailed  53  were  returned,  34.2  percent. 

The  results  at  table  27  indicate  high  patient  dissatisfaction  with  two 
specific  operations,  food  service  and  housekeeping.  Copies  of  specific 
comments  about  an  area  were  made  available  to  each  department  chief  concerned: 
Patient  Administration;  Chief,  Professional  Services;  Chief  Nurse;  Chief, 

Food  Service;  Chief,  Service  Branch;  and,  chiefs  of  the  areas  mentioned  in 
general  comments.  The  survey  results  were  provided  the  quality  assurance 
committee.  The  committee  received  a  listing  of  negative  comments  by  area 
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TABLE  27 

Inpatient  Questionnaire  Results 


AREA  FOR  COMMENT 


Comment 

Frequency 


Percent  of 
Total  Comments 


Admissions  A  Disposi¬ 
tions  Office  3  j  j 

Physician  Care  2  38 

Nursing  Care  3  5  ^ 

Food  Service  14  26  4 

Room  Appearance  16  30  2 

Others  Comments  9  17  0 

Other  comments  include:  Pharmacy  2,  Radiology  2,  Room  assignments  with 
smokers  2,  Ambulance  Transportation  1,  Intercom  1,  and  Rude  receptionist 
at  pediatrics  1. 


and  the  total  number  of  positive  and  negative  responses  by  area.  This  gave 
the  committee  a  problem  list  and  an  evaluation  of  inpatient  care  from  the 
patientJs  perspective.  This  information  had  not  been  available  in  the  past 
and  was  useful  to  the  committee  for  monitoring  two  problem  areas. 

The  Chief,  Food  Service  and  Chief,  Service  Branch  have  made  use  of  the 
results  to  improve  their  areas.  The  dietitian  questions  the  patients  about 
the  condition  of  their  food  during  her  daily  patient  rounds.  Previously, 
there  had  been  no  indication  to  her  by  patients  of  the  food  being  unaccept¬ 
able.  The  Chief,  Service  Branch  was  aware  that  less  than  optimal  room 
cleanliness  was  performed.  This  was  often  linked  to  patient  room  changes 
and  personnel  shortages.  In  an  effort  to  improve,  the  housekeeping  indi¬ 
viduals  having  room  cleaning  responsibility  were  assigned  specific  areas. 


It  is  anticipated  that  this  will  improve  the  individuals-1  pride  in  their 
work  and  produce  a  cleaner  room.  However »  until  the  personnel  shortage  is 
reduced  the  problem  will  probably  continue. 


The  inpatient  questionnaires  will  be  distributed  again  during  April  and 
May  1981.  The  results  of  this  questionnaire  will  be  to  evaluate  performance 
and  identify  new  problems  for  quality  assurance.  The  questionnaires  will  be 
used  on  a  semiannual  basis,  thereafter,  to  identify  problems  and  evaluate 
performance. 

Outpatient  Questionnaires 

The  research  methodology  did  not  produce  a  separate  outpatient  question¬ 
naire.  Upon  analysis,  the  research  questionnaires  solicited  150  of  158 
problems  in  the  outpatient  area  and  41  of  48  high  performance  comments  in 
the  outpatient  area.  This  was  felt  to  be  sufficient  input  about  outpatient 
care. 

The  US  Army  Health  Services  Command  Outpatient  Satisfaction  S'irvey 
(OSSS)  is  designed  to  elicit  such  responses.  See  appendix  0  for  a  survey 
and  instructions.  However,  it  is  not  clinic  specific.  It  is  designed  to 
elicit  responses  about  the  outpatient  care  provided  at  military  hospitals 
without  regard  to  a  specific  outpatient  clinic.  The  OSS  solicits  input  from 
outpatients  visiting  the  hospital  on  a  one-time,  annual  basis.  To  compare 
the  OSS  results  with  the  survey  questionnaire  results  it  was  assumed  that  a 
response  of  somewhat  dissatisfied  or  very  dissatisfied  by  an  outpatient 
indicated  a  problem.  The  results  of  the  OSS  are  at  table  28. 

For  the  OSS,  problems  identified  by  five  percent  (193  responses  x  .05  = 


9.65  or  10)  of  the  respondents  will  be  considered  significant.  The  project 
questionnaires  used  a  ten  percent  identification  response  for  placing  the 
problem  on  a  prioritization  list.  These  problems  and  the  percentage  identifi¬ 
cation  are:  waiting  time  at  the  pharmacy,  19.7%;  waiting  time  for  an  appoint¬ 
ment,  9.3%;  waiting  time  in  the  emergency  room,  7.8%;  waiting  time  at  X-ray 
or  laboratory,  5.7%,  and  the  pharmacy  staff,  5.7%.  Comparison  to  the  problems 
initially  identified  by  the  patient  questionnaire  is  at  table  29. 


TABLE  29 

Comparison  of  Problems  Identified  by 
Outpatient  Satisfaction  Survey  and  Project  Questionnaire 


Problcms-Survey 

% 

Problems- Questionnaire 

Waiting  Time  for  Pharmacy 

19.7 

Need  More  Physicians 

Waiting  Time  for  Appointment 

9.3 

Improve  Pharmacy 

Waiting  Time  in  ER 

7.3 

Improve  Staff  Attitude 

Waiting  Time  at  X-Ray  or  Lab 

5.7 

Improve  Appointment  System 

The  Pharmacy  Staff 

5.7 

Improve  AM1C-GMC 

Improve  Pediatrics 

Both  methods  identify  the  pharmacy  and  the  appointment  system  as  pro¬ 
blem  areas  for  outpatients.  The  OSS  identifies  waiting  time  in  two  clinics 
as  problems.  The  project  identifies  four  other  problems.  The  OSS  would 
indicate  the  problem's  importance  by  the  percentage  of  negative  comments. 

The  project  allows  the  patient  to  rank  the  problems  in  relation  to  one 
another.  This  is  important  as  the  priority  changed  after  the  second  survey. 
This  demonstrates  that  the  initial  ranking  of  a  problem  does  not  necessarily 
make  it  as  important  as  another  problem.  For  a  discussion  of  this  point, 
refer  to  the  summary,  this  chapter. 
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What  this  demonstrates  are  some  problems  with  the  OSS.  The  survey 
limits  patient  input  to  the  twenty  five  questions  asked;  it  does  not  allow 
the  relative  importance  of  one  problem  to  another  to  be  compared;  does  not 
lend  itself  to  specific  clinic  identification;  and  does  not  encourage  patient 
initiated  comments  about  the  hospital.  Another  problem  is  the  raw  data  is 
sent  to  Health  Services  Command  for  analysis.  The  January  1981  OSS  results 
are  ninety  days  old  and  have  not  been  returned  to  Lyster  Hospital.  Thus, 
analysis  by  hand  must  be  completed  at  the  local  hospital  to  have  timely 
resul ts. 

The  OSS  does  obtain  a  large  sample  size  but  does  not  seek  opinions  from 
the  different  population  segments.  Thus,  the  results  could  be  biased 
because  one  group  was  more  heavily  sampled.  This  OSS  received  responses 
from  129  dependents  of  active  duty,  38  retirees  and  their  dependents,  and  26 
active  duty.  The  dependents  had  a  much  larger  input  to  the  results.  This 
biases  the  results  to  the  dependentsJ  perception  of  outpatient  care.  The 
project  offers  a  patient  originated  problem,  relative  comparisons,  and  a 
timely  method  to  obtain  pertinent  problem  perceptions. 

Comparison  with  Other  Problem  Identi fication  Documents 

Each  military  hospital  is  subject  to  inspections  by  outside  agencies. 

These  are  the  Inspector  General,  US  Army  Audit  Agency,  and  JCAH.  The  results 
of  these  inspections  should  produce  identified  problems  for  the  Quality 
Assurance  Committee  to  use  for  improving  patient  care. 

Although  the  agency's  purpose  may  not  be  to  identify  specific  patient 
care  problems,  any  evaluation  of  the  hospital  as  a  whole  entity  must  be  able 
to  identify  problems  influencing  patient  care.  The  1980  HSC  General  Inspection, 
1980  US  Army  Audit  Agency  report,  and  1981  JCAH  survey  summation  conference 
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were  reviewed  for  similar  problem  identification  to  patient  perceptions.  If 
the  same  problems  were  identified  then  the  patient  survey  technique  would 
merely  supplement  the  findings.  However,  if  the  patient  surveys  produced 
different  problems  then  the  project  could  be  considered  a  good  problem 


source. 


The  1980  HSC  General  Inspection  found  fifty  one  findings  which  required 
action  by  the  hospital.  None  of  these  findings  were  related  to  or  coincided 
with  problems  identified  by  patients. 

The  1980  US  Army  Audit  Agency  inspection  at  Lyster  Hospital  produced 
five  major  findings.  None  of  these  findings  were  related  to  the  problems 
identified  by  the  patient  questionnaires. 

The  1931  JCAH  Accreditation  Survey  Summation  Conference  was  reviewed 
for  findings  related  to  staff  or  patient  questionnaire  results.  There  were 
no  findings  that  related  to  patient-staff  identified  problems. 

What  may  be  concluded  is  that  the  patient-staff  questionnaire  is  a  good 
tool  to  identify  problems  not  discovered  by  outside  inspecting  agencies  for 
use  with  the  hospitals  QA  program. 

Summary 

The  methodology  was  useful  in  allowing  patients  and  staff  to  identify 
problems  and  rank  them  accordingly.  Combined,  the  initial  questionnaires 
identified  approximately  155  problems.  The  problems  most  Identified  were 
not  necessarily  the  problems  with  the  highest  priority.  Table  30  lists  the 
problems  most  identified  by  patients  and  staff  with  the  priority  assigned 
to  the  problem;  and,  helps  illustrate  that  the  frequency  identification  of  a 
problem  does  not  confirm  its  importance  in  relation  to  other  problems. 

Both  patients  and  staff  rearranged  the  problems^  importance  when  asked 
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to  rank  them  against  one  another.  The  ranking  allows  certain  statistical 
tests  to  be  applied  that  reveal  the  degree  of  association  and  significance 
of  one  problem  area  over  another.  This  is  useful  when  resources  limit  the 
number  of  problems  to  be  acted  upon.  The  drawback  to  having  problems  priori¬ 
tized  is  the  additional  time  in  preparing,  mailing,  and  evaluating  the 
questionnaires.  For  a  hospital  in  a  hurry  to  get  a  patient  or  staff  problem 
list,  the  ranking  phase  may  not  be  performed.  However,  the  difference  in 
initial  frequency  and  final  priority  and  the  relative  importance  of  one 
problem  to  another  would  indicate  an  advantage  to  prioritizing  the  problems. 


TABLE  30 

The  Initial  Frequency  of  a  Problem 
Compared  to  the  Ranking  by  Patient  and  Staff  Groups 


Initial 


Frequency 


1 

3 

A 

2 

6 

5 


3 

2 

1 

5 
A 

6 


Patients'  Problems 

Need  More  Physicians 
Improve  Staff  Attitude 
Improve  Appointment  System 
Improve  Pharmacy 
Improve  Pediatrics 
Improve  AMIC-GMC 

Staffs'  Problems 

Reduce  the  I’hysician  Shortage 

Improve  Patient- Staff  Relations 

Have  a  Walk-in  Clinic 

Reduce  Pharmacy  Waiting  Time 

Stop  Abuse  of  the  ER 

Have  an  Evening  Pediatric  Clinic 


Final 

Frequency 


1 

2 

3 

A 

5 

6 


1 

2 

3 

A 

5 
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In  using  the  questionnaires  to  identify  hospital  problems  for  the 
quality  assurance  committee,  the  approach  was  taken  that  no  problem  is 


insigni ficant,  but  many  were  omitted  from  further  consideration.  After  the 
initial  questionnaires  had  been  evaluated,  a  problem  list  was  presented  to 
the  quality  assurance  committee.  All  problems  were  listed  showing  the  fre¬ 
quency  and  group  that  identified  the  problem.  This  allowed  the  committee 
to  initiate  action  in  those  areas  it  deemed  necessary.  In  the  pharmacy,  an 
independent  study  was  initiated  to  determine  the  mean  waiting  time  at  half- 
hour  segments.  This  would  show  peak  usage  times  and  allow  the  patient  to  be 
informed  about  those  times.  The  pharmacist  initiated  a  program  to  allow 
refills  to  be  dropped  off,  similar  to  camera  film  developing,  and  picked  up 
the  next  day.  The  Chief,  Professional  Services  made  changes  in  the  AMIC-GMC 
to  allow  greater  accessabil ity  to  the  clinic.  Problems  with  the  capability 
of  being  solved  by  the  area  or  clinic  supervisor  were  brought  to  their 
attention  for  correction. 

The  prioritized  problem  list  was  separated  by  patients  and  staff. 

Table  31  compares  the  two  lists.  The  patients  and  staff  selected  the  physi¬ 
cian  shortage  as  the  most  important  problem.  This  problem  was  significantly 
different  from  all  other  patient  problems  and  all  staff  problems  except 
improving  patient-staff  relations.  The  second  problem  was  improving  patient- 
staff  relations  and  improving  staff  attitude.  The  staff  considered  this 
problem  significantly  different  from  the  other  four  problems,  while  patients 
considered  it  almost  equal  to  improving  the  appointment  system  and  not 
significantly  different  from  improving  the  pharmacy.  The  staff  considered 
having  a  walk-in  clinic,  reducing  pharmacy  waiting  time,  and  stopping  abuse 
of  the  ER  almost  equal.  Having  an  evening  pediatric  clinic  was  almost 


TABLE  31 


Comparison  i 

of  Patient 

of  Problems  with 

Rj  Totals 

Patients 

Ri  Total 

Need  More  Physicians 

305.2 

Improve  Staff  Attitude 

477.2 

Improve  Appointment  System 

477.7 

Improve  Pharmacy 

513.2 

Improve  Pediatrics 

567.2 

Improve  AMIC-GMC 

621.2 

Kjs  Value  *  92.05 


and  Staff  Rankings 
and  Significance  Values 


'  Staff  Rj  Total 


Need  More  Physicians  135 

Improve  Patient-Staff 
Relations  187 

Have  a  Walk-in  Clinic  277 

Reduce  Pharmacy  Waiting  Time  292 
Have  an  Evening  Pediatric 
Clinic  346 


Rjs  Value  =  67.13 


significantly  different  from  those  three.  The  patients  considered  im¬ 
proving  pediatrics  and  improving  the  AMIC-GMC  the  last  two  problems.  It 
must  be  noted  that  the  patients  identified  the  pediatric  clinic  with  the 
highest  frequency  as  a  best  performance  area  in  the  hospital.  Taking  this 
into  consideration,  the  concentration  in  pediatrics  should  be  on  those 
specific  items  of  dislike  and  a  patient-staff  education  program  toward  this 
end. 

This  tells  the  quality  assurance  committee  that  patients  and  staff  per¬ 
ceive  the  shortage  of  physicians  and  the  associated  limited  services  as  the 
leading  problem  facing  the  hospital.  Whether  the  shortage  is  in  personnel 
assigned  or  in  personal  productivity  will  have  to  be  determined  prior  to  a 
problem  resolution  plan.  In  either  case,  the  QA  committee  must  work  to  have 
more  physicians  assigned  or  improve  physician  availability.  Both  groups 
identify  improving  patient-staff  relations  or  staff  attitude  as  the  next 
most  important  problem.  The  quality  assurance  committee  can  have  a  great 
impact  by  actively  promoting  good  patient  relations  as  a  high  priority 


activity  and  initiating  an  active  staff-patient  education  program.  This 
will  be  a  long  term  program  as  attitudes  do  not  change  quickly.  Improving 
the  appointment  system  and  having  a  walk-in  clinic  both  reference  accessabil ity 
to  care.  The  problem  of  improving  the  primary  entry  point  for  health  care 
will  not  only  reduce  these  problems  but  improve  other  identified  problem 
areas  such  as  improving  AMIC-GMC,  stopping  abuse  of  the  ER,  and  establishing 
an  evening  pediatric  clinic.  Improving  the  pharmacy  and  reducing  pharmacy 
waiting  time  are  fourth  on  both  lists.  This  problem  may  have  the  best 
possibility  for  a  quick  fix  since  it  involves  one  area  and  has  high  patient 
visibility.  Consequently,  an  improvement  will  be  experienced  by  more  people 
and  the  hospital's  potential  good  will  from  responding  to  a  patient  and 
staff  problem  quickly  is  excellent. 

How  the  quality  assurance  committee  decides  to  attack  these  problems 
and  what  order  they  choose  cannot  be  dictated  but  the  similarities  between 
the  patients  and  staff  in  problem  identification  and  priority  should  not  be 
ignored. 

The  observation  that  so  few  inpatient  problems  were  identified  by  the 
random  questionnaire  should  lead  to  a  separate  inpatient  questionnaire  for 
evaluation  of  inpatient  functions.  The  results  of  this  questionnaire  are 
useful  in  identifying  specific  inpatient  problems,  such  as  food  service  and 
room  cleanliness,  and  follow-up  questionnaires  can  be  useful  evaluation 
tools. 

For  the  quality  assurance  committee  to  learn  about  specific  patient 
group  preferences,  the  lists  of  patient  specific  problems  were  presented. 

See  table  32.  These  lists  showed  a  strong  preference  by  active  duty  and 
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TABLE  32 

Prioritized  Problems  From  Specific  Patient  Groups 

ACTIVE  DUTY 


'"Problem  o  Rj  Total 

Emergency  Room  82.5 

Appointment  System  107 

Staff  Attitude  109 

Pharmacy  135.1 


RJs  Value  31.55 

DEPENDENTS  OF  ACTIVE  DUTY 


Problem  Rj  Total 

Need  More  Physicians  107 

Improve  Emergency  Room  148 

Improve  Staff  Attitude 
to  Patients  162 

Improve  Pediatrics  162 

Improve  Pharmacy  165 

Improve  AMIC-CMC  201 


Rjs  Value  52.00 


RETIREES  AND  THEIR  DEPENDENTS 


Need  More  Physicians  140.7 
Physical  Exams  for  Retirees  222.2 
Dental  Care  222.7 
Improve  Appointment  System  224.2 
Improve  Pharmacy  225.0 
Improve  EENT  Clinic  231.5 
Improve  GYN  Clinic  295.7 


Rjs  Value  70.63 
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dependents  of  active  duty  to  improving  the  emergency  room.  This  area  is 
often  the  primary  souce  of  care  after  normal  hours  and  on  weekends.  It  sees 
many  nonemergency  conditions  which  could  be  better  treated  during  normal 
duty  hours.  Recalling  the  physicians'  argument  and  the  staff's  perception 
of  emergency  room  abuse,  this  area  deserves  some  attention.  The  retirees 
appear  very  interested  in  gaining  more  services,  such  as  physical  exams  and 
dental  care.  They  seem  satisfied  with  their  primary  entry  sources,  AMIC-GMC 
and  ER,  but  want  more  service. 

Overall,  the  type  of  problems  identified  lends  itself  to  the  structure 
approach  to  quality  assurance.  Neither  patients  nor  staff  appear  to  have 
any  misgivings  about  the  service  rendered,  the  problem  appears  to  be  with 
its  availability,  accessabil ity ,  and  the  process  experienced  to  gain  the 
service.  This  could  indicate  confidence  in  the  hospital's  ability  or  ignorance 
on  the  part  of  the  patient  and  staff.  The  structural  domination  of  the 
problem  lists  may  indicate  that  the  hospital  is  being  judged  on  its  hotel 
appearance,  that  is,  the  friendly,  customer  oriented  staff  approach  in  a 
clean  adequate  structure.  Further  research  on  this  area  of  structure  versus 
process  evaluation  may  be  necessary  but  should  not  delay  the  actions  needed 
to  correct  identified  problems. 

In  examining  the  groups  for  association  and  preference  some  observations 
were  made.  Table  33  indicates  some  groups  have  closer  associations  than 
others,  the  majority  being  hospital  groups.  These  could  be  sampled  in  small 
numbers  for  problem  prioritization;  whereas,  groups  with  small  Kendall  W's 
may  require  a  larger  sample  to  achieve  a  coherent  ranking.  It  must  be  noted 
that  all  groups  demonstrated  a  low  probability  p  <  .01  of  the  association 

being  by  chance.  The  high  Kendall  does  not  mean  the  judgment  was  correct 
but  that  the  group  used  similar  criteria  to  rank  the  problems. 


8 


.1  K«i.i  •-.  -r.  * „  -f.-v-Twy.  -v  v  .’v/v-v-v .v.  '.^/v  w.*rj*  •.»  ’.jHjrvt  ’isnr  xifl  \y  l^1  ^.VATViVXVA". V, viv  vvt*  yrsn»  v_»  vt.' 

•s 

• 

fa 

■ 

% 

k. 

'i 

r, 

95 

1 

8 

k 

It  *as  interesting  to  note  the  retirees 

'  high  Kendall  for  general  £ 

\^m 

hospital  problems.  If  this  problem  ranking 

is  a  good  indicator,  retirees  ^ 

B 

use  the  same  criteria  to  evaluate  problems. 

Thus  implementing  a  change  \ 

I 

suggested  by  retirees  can  be  expected  to  have  a  positive  impact  on  a  large  “r 
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segment  of  the  supported  population. 
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TABLE  33 
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Kendall  W  for  Groups  Ranking  General  Problems  A 

* 

CROUP 

a 

KENDALL  W 

[> 

•> 

Ancillary  Personnel 

> 

.578  -i 

‘j 

Paramedical  Personnel 

.554  > 

•j 

Administrators 

.416  ^ 

y 

Retirees  and  Their  Dependents 

.379  ; 

Staff  as  a  Croup 

.  332  £ 

■ 

Clerical  Personnel 

.317 

P 

Nurses 

.210 

r- 

Patients  as  a  Group 

.170 

f" 

Active  Duty 

.166 

|\ 

Dependents  of  Active  Duty 

.135 

Is 

Commanders 

.088 

•t 
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CONCLUSION 


__  The  purpose  of  this  project  was  to  test  a  method  for  developing  a 
problem  list  using  patient  and  staff  perspectives  to  be  used  in  the  hospi¬ 
tal's  quality  assurance  program.  It  involved  the  random  sampling  of  pat¬ 
ients  and  staff,  evaluating  responses,  and  asking  the  patients  and  staff  to 
rank  those  problems  with  high  initial  frequency.  The  list  was  to  be  a 
useful  tool  for  the  hospital's  quality  assurance  program. 

The  project  did  develop  useful  problem  lists  for  Lyster  Hospital's 
Quality  Assurance  Committee.  The  list  was  used  by  the  committee  to  pinpoint 
problems,  verify  suspicions,  and  evaluate  performance.  The  method's  strengths 
are  the  problem  picture  developed  from  the  staff  and  patient  viewpoint  and 
the  relative  importance  among  problems.  The  list  of  best  performance  areas 
provides  a  good  rating  of  where  the  patient  and  hospital  have  a  good  mesh  of 
expectation  and  performance.  The  methodology  is  not  expensive  but  does 
consume  about  eighty  hours.  See  appendix  N.  More  time  would  have  been 
involved  if  the  response  were  greater.  The  methodology  does  have  drawbacks. 
The  process  takes  approximately  ten  to  twelve  weeks  from  start  to  finish. 

Eight  weeks  must  be  allowed  for  the  two  mailings.  This  could  be  reduced  by 
only  using  one  mailing  for  problem  identification  or  hospital  picked  problem 
ranking.  This  may  be  a  consideration  when  one  observes  the  similarities 
between  the  staff  and  patient  final  ranked  problems.  However,  the  total 
problems  identified  in  the  initial  mailing,  approximately  155  would  not  be 
available.  If  the  problems  are  not  prioritized,  the  chance  increases  that 
the  most  important  problem  will  not  be  given  proper  attention.  It  is  recom¬ 
mended  to  have  both  mailings  to  gain  full  advantage  of  the  methodology. 

Most  of  all,  the  methodology  requires  the  support  of  the  QA  committee. 
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The  committee  has  the  prerogative  to  act  and  to  initiate  action  to  resolve 
identified  problems.  Without  this  support,  the  hospital's  quality  assurance 
program  will  not  have  the  staff's  support  and  become  an  exercise  in  place  of 
an  active  problem-focused,  result-oriented  program. 

The  methodology  has  potential  for  use  as  an  annual  evaluation  of  hospi¬ 
tal  performance  and  quality  assurance  progress.  It  can  be  an  effective 
public  relations  tool  to  enhance  the  hospital's  image  through  community  and 

staff  involvement  with  hospital  planning.  ~  ~  **■- . 

The  problems  uncovered  by  the  methodology  were  more  extensive  and 
meaningful  than  the  Health  Services  Command  Outpatient  Satisfaction  Survey. 
The  problems  discovered  by  the  Health  Services  Command  Annual  General  Inspec 
tion,  US  Army  Audit  Agency,  and  JCAH  Accreditation  Survey  did  not  relate  to 
particular  staff  perceived  problems  with  health  care  delivery.  Thus,  it  is 
a  useful  tool  to  supplement  outside  inspecting  agencies. 

Overall,  the  method  is  a  good  tool  for  problem  identification,  priori¬ 
tization,  and  performance  evaluation  in  the  perspective  of  staff  and  pat¬ 


ients. 
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APPENDIX  A 
DEFINITIONS 

Civilian  Health  and  Medical  Program  for  the  Uniform  Services  (CHAMPUS) — a 
cost  sharing  program  that  assists  Army  personnel  with  civilian  medical 
bills. 

Health  Services  Command  Annual  General  Inspection  --  Army  team  which  inspects 
Army  hospitals  for  compliance  with  regulations  and  directives. 

Health  Services  Command  (HSC)  — The  US  Army  headquarters  with  responsibil  ity 
for  operation  of  all  Army  hospitals  in  the  United  States  and  Panama. 

Quality  Assurance  (QA)  —  a  program  designed  to  evaluate  the  appropriateness 
and  quality  of  medical  care  services. 

United  States  Army  Reserve/United  States  Army  National  Guard  (USAR/USANG)  -- 
the  nonactive  duty  component  of  the  US  Army. 


\ 


Physicians 

Nurses 

Administrators 
Ancillary  Personnel 


60,61 


Paramedical 


Clerical  and  Support 


91F,G,J,N,P,Q 

92B.94F 


51P,71B,G,L; 
75C,Z;  76J 


602,662 


185,186,636 

645,646,647 

649,660,661 

699,5213,7402 

7404,7407 


91B,C,D,H,P,Q,U,  621,622 


303,305,318,322 

334,343,344,356 

357,501 ,510,669 

675,525,679,856 

962,998,1411 

2005,3566, 

4805,5703,6907 


's'-.W. V.V.Vjv’ V.V.V. ^  .  .  v.v.- 
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Civilian  Job  Positions  by 
General  Schecule 

185  -  Social  Worker 

186  -  Social  Service  Assistant 
303  -  Admin  Support  Clerk 

305  -  Mail  Clerk 

318  -  Secretary 

322  -  Clerk  Typist 

334  -  Computer  Specialist 

343  -  Management  Analyst 

344  -  Management  Assistant 

356  -  Data  Transcriber 

357  -  Coding  Clerk 
501  -  Budget  Clerk 
510  -  Auditor 

525  -  Accounting  Technician 
560  -  Budget  Analyst 
602  -  Physician 
610  -  Nurse 

621  -  Nurse  Assistant 

622  -  Medical  Aid  (CMS) 

636  -  Physical  Therapy 
644  -  Medical  Technologist 


Wage  Grade 

3111  -  Not  authorized 
3502  -  Not  authorized 
3566  -  Janitor 

4805  -  Medical  Equipment  Repair 
5212  -  Laboratory  Worker 
5703  -  Motor  Vehicle  Operator 
6907  -  Warehouse  Worker 
7402  -  Cook 
7404  -  Cook  Leader 

7407  -  Meatcutter 

7408  -  Food  Service  Worker 


645  -  Medical  Technician 

646  -  Histopath  Technician 

647  -  Radiology  Technician 

649  -  Medical  Machine  Technician 

660  -  Pharmacist 

661  -  Pharmacy  Technician 

662  -  Optometrist 

669  -  Medical  Records  Librarian 
675  -  Medical  Records  Technician 
679  -  Medical  Clerk 

681  -  Dental  Assistant 

682  -  Dental  Hygienist 

683  -  Dental  Lab  Technician 

684  -  Public  Health  Dental  Hygienist 
699  -  Emergency  Medical  Technician 
856  -  Electronics  Technician 

962  -  PEB/CHAMPUS  Contact  Rep 
998  -  Claims  Clerk 
1411  -  Librarian 
2005  -  Supply  Clerk 


APPENDIX  D 


HOSPITAL  STAFF  QUESTIONNAIRE 


n 


► 


Vl 


5! 


\4 


B*J/ n*.  >1)  >  ..  t, '-HViaVt  n  *.:  V.  14  _  3 

Fof  u««  r.f  t  .l«  lat-n,  ««»  A;i  i»0-iS,  tn»  prcaon«rt  C}«1C|'  /•  TAliCt:N. 
Pf  Ff  Rf/Ct  C.i'  -t  I  ;Cf  St-*baL  fiJuitCT 


S:  23  Jan  81 


ATZQ-A \MC-CS 


;  Quality  Assurance  Questionnaire* 


f0  r.acli  Stai  f  Member 


FiiOM  Chief  of  Staff,  USAAMC  DATE 


1.  Definitions: 


a.  0IVM.1TY  A.SSHRANCK:  A  well  defined  program  designed  to  enhance  patic*.nt  care 
through  an  ongoing  objective  assessment  of  the  important  aspects  of  patient  care  and 
the  correction  of  identified  problems. 


b.  JOINT  COMMISSION  ON  THD,  ACCREDITATION  OF  HOSPITALS  (JCAil):  An  organization 
composed  of  the  American  College  of  Surgeons,  the  American  College  ol  Physicians,  the 
American  Hospital  Association,  and  the  American  Medical  Association.  The  commission 
accredits  hospitals  that  meet  high  health  care  delivery  standards  by  comparing  per¬ 
formance  against  established  criteria  in  all  hospital  areas  that  contribute  to  good 
patient  care:  safety,  building,  equipment,  personnel,  and  administration. 


2.  During  1979,  the  JCAH  changed  its  requirements  for  the  health  care  Quality  Assur¬ 
ance  Program.  The  change  required  hospitals  to  have  a  program  that  continually  asses¬ 
sed  quality  and  corrected  identified  problems.  Before  the  change,  the  JCAH  Quality 
Assurance.  Program  was  based  almost  solely  on  medical  record  audits  and  committee  meet¬ 
ings.  Now  the  program  is  to  be  hospital  specific  and  problem  oriented.  The  new  JCAH 
requirements  require  active  staff  participation  in  the  Quality  Assurance  Program  to  be 
successful . 


3.  ‘  This  staff  survey  will  be  conducted  in  two  parts. 


a.  Part  1  will  be  staff  identification  of  inpatient  and  outpatient  hospital 
procedures  or  areas  needing  improvement.  The  identified  areas  or  procedures  will  be 
grouped  by  how  often  they  are  identified  (frequency).  A  list  will  be  developed  with 
the  most  identified  problems  to  the  least  identified.  This  list  will  be  used  in 
Part  II. 


b.  Tart  II  will  have  different  staff  groups  prioritize  the  identified  problems. 
This  will  be  done  in  small  group  meetings.  Because  of  the  staff's  size,  not  everyone 
will  be  able  to  participate  in  these  group  meetings.  If  you  are  interested  in  parti¬ 
cipating  in  these  meetings,  please  contact  Major  Callaghan,  2316,  by  phone,  buck  slip, 
or  drop  by  room  Y106. 


c.  The  hospital  Quality  Assurance  Committee  will  use  the  prioritized  list  in 
combination  with  a  similar  list  being  developed  from  tile  population  supported' s  input 
to  have  a  single  hospital  problem  list.  The  list  will  be  used  for  long  and  short 
range  planning,  improvement  of  patient  care,  and  improvement  of  hospital  working  con¬ 
ditions  . 


4.  Return  the  attached  survey  to  Major  Callaghan  not  later  than  23  January  1981. 


1  Incl 


D0NA1.D  L.  NAYLO^/ 
COD,  MSC 


Chief  o f  Staff 


I _ 

ft  A  1  u  '■>  r>,  •  .  .  < ' 

UM  I'tm  .C  *  v  UO 


/;L,ACi::i  Co  "f  OnWsV'wH  1C H  IS  OPsOLfcTE. 


V^GPO  -  1975— GGb  4221003 


f.  r.  tt-m  «-  -r.  **.  r.  w  .V  »*\  ./•  V\  -'V  V.  «•  'p".  AV.  rnm- 


TO:  Major  Callaghan  103 

Room  Y106,  Hospital  Headquarters 


fold  to  here 


I.yster  US  Army  Community  Hospital 
Quality  Assurance  Program 
Staff  Questionnaire 


If  I  had  the  authority,  what  two  actions  would  I  direct  the  hospital 
to  take  to  improve  patient  care.  Remember  that:  patient  care  includes  in¬ 
patients  and  ouloatiants .  Consider  that  health  care  includes  all.  the  people, 
facilities,  equipment,  and  administrative  procedures  necessary  to  appoint, 
give,  and  record  patient  care. 


1. 


2. 


Survey  Grouping  Information 

Military:  MOS _ 

Civilian:  Job  Title 


signature  optional 


Please  fold  to  the  line  and  return. 


O  O  V* 


V 


WV.Vl 
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DEPARTMENT  OF  THE  ARMY 

HEADOU  AHfLRS  UNITED  El  M  f  S  A11MV  AHiCMEDICAL  CENTER 
rO«T  IIUCKlII.  ALABAMA  30302 


ATZQ-AAMC-ZA 


Deal* 

Lyster  US  Army  Community  Hospital  is  vitally  interested  in  providing  the 
best  possible  health  care  to  all  our  beneficiaries  in  the  Fort  Rucker 
community.  '  My  staff  is  working  very  hard  to  insure  that  you  receive 
health  care  of  the  highest  quality.  I  would  appreciate  your  evaluation 
of  how  well  we  are  doing. 

Please  complete  the  inclosed  questionnaire  and  return  it:  in  the  envelope 
provided.  When  all  the  questionnaires  are  returned  a  problem  list  will  be 
developed.  A  second  questionnaire  will  then  be  sent  to  you  asking  that 
you  rank  these  problems  from  most  serious  to  least  serious.  Your  rankings 
will  be  used  by  the  hospital's  Quality  Assurance  Committee  to  assign  projects 
aimed  at  correcting  the  problems. 


Thank  you  for  your  support  in  this  matter  of  paramount  concern  to  us  all. 


1  Incl 


Commanding 


i 


[•] 


Lyster  US  Army  Counv.  ni ‘:y  Hospital 
Quality  Assurance  Program 
Health  Services  Questionnaire. 


Please  complete  the  following  questionnaire  about  Lyster  US  Army 
Community  Hospital.  Answer  the  questions  as  best  you  can.  Your  answers 
will  be  used  to  develop  a  problem  list  for  the  hospital’s  Quality  Assurance 
Program.  Remember  that  the  hospital  includes  all  the  people  that  work  there 
the  clinics,  wards,  and  the  buildings  used  to  give  health  care.  You  may  be 
as  specific  as  you  wish. 

1.  What  three  health  care  services  does  the  hospital  do  best? 


2.  What  three  health  care  areas  need  improvement? 


signature  optional 


Treatment  Eligibility  Status: 

Active  Duty _ 

Spouse  of  Active  Duty,  Retired,  or  Deceased _ 

Retired 


V.V.V.VV.V'/.V  V  ’J  ■>  ■>  .V  \ 


APPENDIX  F 


QUESTIONNAIRE  FOR  COMMANDERS 


i 

I 


DEPARTMENT  Oi-  .  HE  ARMY 

HEAOOUAHTlRS  united  states  army  aeromedical  center 

FORT  RUCKER.  ALABAMA  36362 


VT'-v. 


ATZQ-AAMC-/.A 

SUBJECT:  Health  Services  Questionnaire 


1.  The  US  Array  Aeromedical  Center  has  been  working  very  hard  to  overcone 
the  physician  shortage  experienced  this  summer.  Recently  we  were  successful 
in  having  two  more  physicians  assigned.  We  know  there  are  shortfalls  in 
specialty  areas  such  as  orthopedics;  obstetrics;  ear,  nose,  and  throat;  and 
dermatology.  Wc  are  actively  recruiting  these  specialists  and  are  optimistic 
that  most,  if  not  all  of  them,  will  complement  our  staff  by  this  summer. 

2.  There  are  other  areas  in  our  health  care  delivery  system  that  require 
attention.  We  are  aware  of  many  of  these  areas;  however,  we  need  your 
assistance  in  identifying  those  health  care  areas  wherein  improvement  would 
enable  us  to  provide  better  support  to  your  unit.  We  are  also  soliciting 
comments  from  our  staff,  inpatients,  members  of  the  community,  and  retirees. 

3.  The  attached  questionnaire  should  be  completed  and  returned  to  the 
Aeromedical  Center.  After  these  questionnaires  are  returned,  a  list  will 
be  compiled  of  those  areas  most  identified  by  commanders.  You  will  be 
furnished  a  copy  of  this  list  and  asked  to  prioritize  it.  The  prioritized 
list  will  be  used  by  the  hospital's  Quality  Assurance  Committee  to  initiate 
resolutions  to  the  areas  of  concern. 

A.  1  appreciate  your  time,  in  completing  this  questionnaire.  It  will  serve 
as  a  valuable  input  source  for  refinement  of  the  health  services  wc  provide. 


1  Incl 


ROBERT  J.  KREUTZMANN,  M.D. 

COL,  MC 

Commanding 


IVlUUVi 


Lyster  US  Army  Community  Hospital 
Quality  Assurance  Program 
Commanders'  Health  Services  Questionnaire 


1.  What  area  or  service  does  the  Aeromedical  Center  perform  best  in  supporting 
your  unit? 


2.  What  two  areas  or  services  can  the.  Aeromedical  Center  change  or  add  to 
better  support  your  unit? 


signature  optional 


Remember  that  health  services  support  includes  all  the  people,  material, 
facilities,  and  administration  associated  with  the  Aeromedical  Center. 


I 


,  V,*,"  v  *r_  (T-  <gi *  -  *  «w  -4 


DEPARTMENT  OF  THE  ARMY 

HFAOOUARTERS  UNITED  STATES  ARMY  AE  PC '■%•.  C  D'C  A  L.  CENTER 
FORT  RUCKER.  ALABAMA 


►  A  >  f 

VN.J-"  ■■■/./ 

S  -  > 

'•‘-ii.x-  - 


ATZQ-AAMC-CS 


Lyster  US  Army  Community  Hospital  is  conducting  an  aggressive  information 
program  aimed  at  gathering  perceptions  about  patient  health  care  delivery. 
Active  duty  personnel,  their  dependents,  hospital  staff,  unit  commanders, 
and  ret  Lrees  are  being  surveyed.  The  initial  survey  asks  individuals  to 
identify  strengths  and  weaknesses  of  the  health  care  deiivery  system.  A 
second  survey  will  ask  the  same  individuals  to  prioritize  the  most  identi¬ 
fied  problems.  '.’’his  will  give  the  hospital  a  prioritized  list  by  different 
population  served  categories.  The  list  will  he  used  by  the  hospital's  Quality 
Assurance  and  Executive  Committee  to  plan  and  to  initiate  actions  aimed  at 
correcting  the  problems.  The  result  should  be  improved  health  care  delivery 
for  the  community. 

As  a  retiree  council  member  you  are  in  a  special  position  of  knowledge  and 
interest.  In  addition  to  the  one  hundred  fifty  retirees  being  surveyed, 
it  would  be  very  useful  to  have  you  complete  the  inclosed  questionnaire. 

A  return  envelope  has  been  provided. 

It  is  anticipated  that  the  responses  rroni  all  retlre.es  will  be  received  prior 
to  your  next  meeting.  If  so  a  list  will  be  furnished  yu-r  council  for  discus¬ 
sion  and  prioritization.  If  not,  a  problem  list  will  be  sent  to  you  for 
pri oriti zation. 

Your  time  in  assisting  the  hospital  with  this  undertaking  is  greatly 
appreciated. 


]  Tncl 


t  \  1  TAT  A  T  Aril  AM 


rjjiHN  A.  CALLAGHAN 
W\J,  MSC 
Project  Officer 
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I.yster  US  Army  Common It y  Hospital 
Quality  Assurance*  Program 
Health  Servif.es  Quest  i onrairc 


Pic  a sc  complete  the  following  questionnaire  about  Lyster  US  Army 
Community  Hospital.  Answer  the  questions  as  best  you  can.  Your  answers 
will  be  used  to  develop  a  problem  list  for  the  hospital's  Quality  Assurance 
Program.  Remember  that  the  hospital  includes  all  the  people  that  work  ther 
the  clinics,  wards,  and  the  buildings  used  Lo  give  health  care.  You  may  be 
as  specific  as  you  wish. 

1.  What  three  health  care  services  does  the  hospital  do  best? 


a. 


b. 


c. 


2.  What  three  health  care  areas  need  improvement? 


b. 


c. 


signature  optional 

Treatment  Eligibility  Status: 

Active  Duty _ 

Spouse  of  Active  Duty,  Retired,  or  Deceased _ _ _ 


Retired 


Jj  V* 


X,->~.  ‘-".S 


DEPARTMENT  Or  THE  ARMY 

MEADOUAITl  CHS  UNITED  STATES  ARMY  ATKOMi  OlOAE  CENT  EM 
t  orn  RUCK  LI?.  ALAUAMA  36302 


ATZQ-AAMC-ZA 


You  or  a  member  of  your  family  was  recently  hospitalized  at  Lyster  HS  Army 
Community  Hospital.  To  help  us  maintain  and  improve  our  medical  care  T  would 
like  you  to  complete  the  attached  questionnaire.  It  will  be  used  to  develop 
a  list  of  hospital  areas  our  patients  believe  deserve  attention.  Action  on 
these  areas  will  be  by  the  hospital's  Quality  Assurance  Committee.  Your 
response  is  important  to  our  understanding  how  well  we  perform.  A  return 
envelope  has  been  enclosed  for  your  convenience. 


Sincerely , 


2  Incl 

1.  Questionnaire 

2.  Envelope 


ROBERT  J.  KREUTZMANN,  M.  I). 

COL,  MC 

Commanding 


■  vs 

v  •'  i'1 

l  -  .  r  J  ■  > 


112 

DEPARTMENT  OP  THE  ARMY 

IIFADQU  ARTEC:';  'JMITCO  STATFS  ARMY  AEWOMtOICAL  CKN1FR 
FORT  HUCKFR.  A(  A0.H1A  3C>?6Z 


ATZQ-AAMC-CS 


Thank  you  for  answering  cur  first  questionnaire.  If  you  were  not  able  to 
for  one  reason  or  another,  here  is  your  chance  to  (Jive  our  hospital  some 
advice.  Attached  is  a  second  questionnaire  which  lists  the  problem  areas 
most  identified  on  the  first  questionnaire.  Please  complete  and  return  it 
in  the  self-addressed  envelope  provided. 

Your  compliments  have  been  passed  appropriately  to  my  staff.  These,  kind 
remarks  are  greatly  appreciated  and  very  important  to  us — so  often  only  the 
negative  comments  reach  us. 

The  areas  that  you  identified  as  requiring  improvement  which  are  not  listed 
on  this  questionnaire  will  be  reviewed  by  my  Executive  Committee  and  the 
hospital  area  supervisor  to  which  they  apply. 

Thank  you  for  your  participation  in  this  project..  If  you  have  other  comments 
about  our  hospital,  please  feel  free  to  write  or  talk  with  my  staff,  our 
Patient  Affairs  Officer,  or  your  representative  on  the  Health  Consumer 
Committee. 


1  Incl 
as 


Sincerely, 


g 


✓  J 

qIiM 


ROBERT  .1.  KREUTZMANN,  M.I). 
COL,  MC. 

Commanding 
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LYHTI'R  US  ARMY  COMMUNITY  HOSPITAL 
Quality  Assurance  Program 
Health  Servicer;  Questionnaire 
Act! vc  Duty 


The  following  areas  were  the  most  identified  by  active  duty  soldiers 
in  the  initial  questionnaire  as  requiring  improvement.  Please  rank  these 
areas  in  the  order  of  their  importance  to  you.  (1  =  Highest,  2  =  Next  Highest, 
and  so  on.) 


Appointment  System  _ 

Emergency  Room  _ 

Pharmacy  _ 

Staff  Attitude  to  Patients  _ 

The  following  areas  were  the  most  identified  by  all  respondents  (soldiers, 
dependents,  and  retirees)  in  the  initial  questionnaire  as  needing  improvement. 
Please  rank  these  areas  in  the  order  of  their  importance  to  you.  (1  =  Highest, 
2  -•  Next  Highest,  and  so  on.) 

Appointment  System  _ 

AMIC-GMC  _ 

More  Physicians  Needed  _ 

Pediatrics  _ 

Pharmacy  _ 

Staff  Attitude  to  Patients  _ 

PLEASE  RETURN  THIS  QUESTIONNAIRE  IN  THE  ENCLOSFD  ENVELOPE . 


Signature  Optional 


DEPARTMENT  OF  THE  ARMY 

HEADQUARTERS  UNITED  STATES  ARMY  AERCMEDICAU  CENTER 
FORT  RUCKER.  ALABAMA  30362 


AT  ZQ- AAMC-C  5 


Tliank  you  for  answering  our  first  questionnaire.  If  you  were  not  able  to 
for  one  reason  or  another,  here  is  your  chance  to  give,  our  hospital  some 
advice.  Attached  is  a  second  questionnaire  which  lists  the  problem,  areas 
most  identified  on  the  first  questionnaire.  Please  complete  and  return  it 
in  the  self-addressed  envelope  provided. 

Your  compliments  have  been  passed  appropriately  to  my  staff.  These  kind 
remarks  are  greatly  appreciated  and  very  important  to  us — so  often  only  the 
negative  comments  reach  us. 

Tne  areas  that  you  identified  as  requiring  improvement  which  are  not  listed 
on  this  questionnaire  will  be  reviewed  by  my  Executive  Committee  and  the 
hospital  area  supervisor  to  which  they  apply. 

Tliank  you  for  your  participation  in  this  project.  If  you  have  other  comments 
about  our  hospital,  please  feel  free  to  write  or  talk  with  my  staff,  our 
Patient  Affairs  Officer,  or  yc  ir  representative  on  the  Health  Consumer 
Committee. 


1  Tnc.l 
as 


ROBERT  J.  KREUTZMANN,  M.D. 

COL,  MC 

Commanding 


4 
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LYSTER  US  ARMY  COMMUNITY  HOSPITAL 
Quality  Assurance  Program 
Health  Services  Questionnaire 
Nonact  ive_  Un ty 


The  following  areas  were  the  most  identified  by  nonactive  duty  people 
in  the  initial  questionnaire  as  requiring  improvement.  Please  rank  these 
areas  in  their  order  of  importance  to  you.  (1  =  Highest,  2  =  Next  Highest 
and  so  on.) 

AMIC-GMC  _ 

Emergency  Room  _ 

More  Physicians  Needed  _ 

Pediatrics  _ 

Pharmacy  _ 

Staff  Attitude  to  Patients 


The  following  areas  were  the  most  identified  by  all  questionnaire  recipients 
active  duty,  nonactive  duty,  and  retirees.  Please  rank  these  areas  in  their  orde 
of  importance  to  you.  (.1  =  Highest,  2  =  Next  Highest,  and  so  on  ) 


Appointment  System  _ 

AMIC-GMC  _ 

More  Physicians  Needed  _ 

Pediatrics  _ 

Pharmacy  ‘ _ 

Staff  Attitude  to  Patients  _ 

PLEASE  RETURN  THIS  QUESTIONNAIRE  IN  THE  ENCLOSED  ENVELOPE. 


Signature  Optional 


V\ 


DEPARTMENT  OF  THE  ARMY 

HfADQUAidtliS  UNIItL'  STATES  ARMY  AEHOME.OICA! 

FORT  RUCKtB.  ALABAMA  303 CZ 


CFNT  FR 


AT  7,0-  AAMC-C  S 


Thank  you  for  answering  our  first  questionnaire.  If  you  were  not  able  to 
for  one  re  .son  or  ant  .her,  here  is  your  chance  to  give  our  hospital  some 
advice.  Attached  is  a  second  Questionnaire  'which  lists  the  problem  areas 
most  identified  on  the  first  questionnaire.  Please  complete  and  return  it 
in  the  self -addressed  envelope  provided. 

Your  compliments  have  been  passed  appropriately  to  my  sLaff.  These  kind 
remarks  are  greatly  appreciated  and  very  important  to  us — so  often  only  the 
negative  comments  reach  us. 

The  areas  that  you  identified  as  requiring  improvement  which  are  not  listed 
on  this  questionnaire  will  be  reviewed  by  my  Executive  Committee  and  the 
hospital  area  supervisor  to  which  they  apply. 

Thank  you  for  your  participation  in  this  project.  If  you  have  other  comments 
about  our  hospital,  please  feel  free  to  write  or  talk  with  my  staff,  our 
Patient  Affairs  Officer,  or  your  representative  on  the  Health  Consumer 
Committee. 

Sincerely, 

iiM?  Jj' 

1  In  cl  ROP.CRT  J.  KREUTZMANN,  M.D. 

as  COI.,  MC 

Commanding 
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l.VS  I  T.K  US  AUMV  UuMMUN  l  I  V  HOSPITAL 
(Jim  I  lly  Aiimii  I, mil-  Prog  ram 
Health  .Servlet  :,  Quest  tonnalre 
Retiree.1; 


The  following  areas  were  the  most  identified  by  retirees  in  the  initial 
questionnaire  as  requiring  improvement.  Please  rank  these  areas  in  the  order 
of  their  importance  io  you.  (1  =  Highest,  2  =  Next  Highest,  so  on,  7  -  Lowest.) 

Appointment  System  _  • 

Denta L  Care  _ 

EENT  Clinic  _ 

Gyn  Clinic  _ 

More  Physicians  Needed  _ _ 

Pharmacy  _ 

Physical  Exams  for  Retirees  _ 


The  following  areas  were  the  most  identified  by  all  recipients  (active 
duty,  dependents  of  active  duty,  and  retirees)  in  the  initial  questionnaire. 
Please  rank  these  areas  in  the  order  of  their  importance  to  you.  (1  =  Highest, 
2  ~  Next  Highest,  and  so  on.) 


Appointment  System 
AMIC-GMC 

More  Physicians  Needed 

Pediatrics 

Pharmacy 

Staff  Attitude  Toward  Patients 


PLEASE  RETURN  THIS  QUESTIONNAIRE  IN  THE  ENCLOSED  ENVELOPE. 
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Our  initial  Health  Services  Questionnaire  identified  several  areas  where 
our  pci  ik.  v,.  ancs  does  not.  me  of  ccifjnendev  ’  s  expectations.  The  areas  identified 
most,  often  are  on  the  attached  questionnaire  iur  your  personal  ranking.  Your 
ranking  vl]  1  influence  the  order  in  which  tr.y  staff  will  take  action  to  change 
our  health  care  delivery.  Identified  problem  areas  not  listed  on  this  ques¬ 
tionnaire  will  be  reviewed  by  my  Executive  Committee  for  subsequent  action. 

1  want  to  personally  thank  those  of  you  wh o  completed  the  initial  questionnaire, 
Even  if  you  did  not  complete  it,  please  take  the  time  to  complete  this  one. 

Thanh  you  for  year  support  in  this  project. 


Sincerely, 


1  Inc  1 
as 


l  A  t  - 


&- 


ROBERT  J.  KREUTZMANK ,  M.D. 
COT,,  MC 
Command ing 
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LYSTER  US  ARMV  COMMUNITY  HOSPITAL 
Quality  Assurance  Program 
llealLh  Services  Questionnaire 
Commanders 


The  following  areas  were  the  most  identified  by  commanders  in  the  initial 
ionnaire  as  needing  improvement.  Please  rank  these  areas  in  their  order 
portance  to  you.  (1  =  Highest,  2  =  Next  Highest,  and  so  on.) 


KT  -v  N.  ■  *V  -  V  *w'  ^  .  »_  *v  •_  .  S  «  *-  A.  - 


Appendix  M 
Statistical  Methods 

Kendall  Coefficient  of  Concordance:  W 


The  w  is  a  useful  statistic  to  measure  the  association  between  judges 
ranking  the  same  items.  For  example,  let  table  34  display  three  independent 


rankings  of  four  problems. 


Table  34 


Sample  Calculation  of  W 
Problem  (N) 


Judge(k) 


If  all  the  judges  had  agreed  on  each  problem  the  rankings  would  be  the 
same  and  uie  Rj  values  would  be  multiples  of  k;  k,  2k,  3k.  On  the  other 
hand,  if  the  judges  had  no  agreement,  then  one  would  expect  the  Rj  values  to 
be  about  equal.  The  W  is  a  measurement  of  the  divergence  of  the  actual 
agreement  shown  in  the  data  from  the  maximum  possible  perfect  agreement.* 


The  formula  is 


1/12  (NJ  -  N) 


s  =  Sum  of  the  squares  of  the  observed  deviations  from  the 
mean  Rj 

k  =  Number  of  judges 
N  =  Number  of  items  being  judged 

?  3 

1/12  k  (N  -  N)  =  Maximum  possible  sum  of  the  squared  deviations, 

sum  of  s  with  perfect  agreement. 


I 


ft 

I 


Qi 

fin 


Computation  of  Sample 

s  =  (8  -  7.5)2  +  (12  -  7.5)2  *  (6  -  7.5)2  +  (4  -  7.5)2 
s  =  35 

W  = _ 35 

1/12  (3)2  (43  -4) 

W  =  35 
45 

W  =  .778 

W  =  .778  expresses  the  degree  of  association  among  the  three  judges. 

To  test  the  significance  of  W,  one  can  determine  the  probability  associated 
with  the  occurence  under  a  HQ  of  a  value  as  large  as  the  s  with  which  it  is 
associated.  If  one  obtains  the  sampling  distribution  of  s  for  all  permutations 

Is 

in  the  N  ranks,  in  all  possible  ways  in  the  k  rankings,  one  will  have  (N!) 

sets  of  possible  ranks.  Using  this,  the  null  hypothesis  that  k  sets  of 

rankings  are  independent  by  taking  from  this  distribution  the  probability 

associated  with  the  occurrence  under  HQ  of  a  value  as  large  as  an  observed  s 
2 

may  be  tested. 

The  null  hypothesis  is:  The  judges  rankings  are  unrelated.  The  alternate 
hypothesis  is  the  rankings  are  related.  To  compute  this,  the  table  in 

3 

Siegel  may  be  used  for  small  values  of  k  and  N  or  a  chi  square  table  may  be 
used  for  large  values  of  N  and  k.  The  formula  is 


Using  the  sample  X^  calculation 


k  -  k  ( N— 1 )  U 


3(4  -  1)  .778 


x£  =  7.002 


df  =  N-l 


df  =  3 


The  probability  of  Ho  occurrance  is  .1  >  p  >  .05.  This  enables  the 
Hq  to  be  rejected  at  those  levels.  It  may  be  concluded  that  the  judges' 
rankings  were  related  at  the  level  of  confidence  .1  >  p  >  .05. 

Another  method  of  determining  the  rankings  is  to  compare  the  RjJs. 
Kendall  suggests  this  to  be  the  best  estimate  when  W  is  significant.  If  one 
accepts  the  criteria  that  the  judges  have  agreed,  then  the  RjJs  will  give 
the  order  of  importance. 

When  asking  judges  to  rank  items  the  possibility  exists  that  some 
judges  will  rank  items  equally.  The  W  calculation  is  slightly  modified  to 
accommodate  these  ties. 


1/12  k*  (N3  -  N)  -  k  ^  T 


(f3  -  t) 


t  =  represents  the  number  of  tied  items 
Example:  In  the  ranking  of  general  patient  problems  by  active  duty 
personnel,  four  individuals  ranked  one  or  more  problems  equally.  To  calculate 
the  T,  the  number  of  ties  are  calculated: 

Tn  =  (23  -2)  +  ( 33  -  3)  =  2.5 


In  this  example  the  judge  has  given  two  items  equal  value  and  three 

other  items  equal  value 

T2  =  (23  -  2)  +  (33  -  3)  =  2.5 
12 

T3  =  (53  -  5)  =  1 0 

12 

T4  =  (23  -  2)  =.5 

12 

The  total  T  value  is  15.5. 

To  complete  W 

W  = _ 4971.5 _ 

1/12  (42)*  (6^  -  6)  -  (42)  (15.5) 

W  =  .165 

Note  that  the  W  will  be  depressed  when  the  normal  formula  is  applied  in 
place  of  the  formula  for  ties. 

A  program  was  developed  to  allow  the  s,  Rj ,  and  W  to  be  calculated  by 

computer.  The  program  is  at  the  end  of  this  Appendix.  When  ties  occurred 
2 

or  the  X  value  was  computed,  this  was  not  performed  on  the  computer, 
n  summary,  to  compute  W 

£.  Let  N  =  the  number  of  problems  and  k  =  the  number  of  judges. 

b.  Place  the  rankings  in  an  kxN  table. 

c.  Determine  the  Rj  for  each  N. 

d.  Determine  the  mean  Rj. 

e.  Compute  s  by  computing  the  deviations  between  Rj  and  the  mean  Rj. 
Square  these  deviations  and  add  them  together. 


f.  Compute  W  using  the  formula  with  or  without  ties. 


I1 

I* 


g.  Determine  if  the  observed  value  of  W  is  significantly  different 

2 

from  zero  by  using  the  formula  to  compute  an  X  value  with  df  =  N-l . 
Friedman  Two-Way  Analysis  of  Variance 


This  statistic  will  be  used  to  test  the  null  hypothesis  that  there  is 
no  difference  in  the  preference  of  all  the  judges  for  any  problem  being  more 
important  than  another.  The  statistic  shows  whether  the  rank  totals  (Rj) 


differ  significantly.  The  formula  is 


X?1  =  12 


^(Rj)2  -  3k  (N  +  1) 


kN(N  +  i)  rr1 

k  =  the  number  of  judges 

N  =  the  number  of  problems 

Rj  =  the  sum  of  the  rankings  by  all  judges  on 


a  particular  problem 


Using  the  sample  at  table  30 


8^  +  12c  +6^+4 


■)-  3  (3) 


(3)  (4)  (5) 

12  (260)  -  45 


Using  the  table  Ob  in  Daniel  gives  a  value  p  =  .054,  N  =  4,  and  K  =  3. 
When  the  values  of  K  and  N  exceed  the  tables  in  Daniel  a  chi  square  table  is 
used  with  N-l  degrees  of  freedom.  Thus,  the  probability  that  HQ  is  valid  is 
<,  .054.  The  conclusion  may  be  made  that  the  judges  did  not  select  the 
problems'  importance  at  random  but  had  a  definite  preference  for  one  problem 
over  another,  at  the  level  of  significance  calculated. 

To  test  whether  one  Rj  differs  significantly  from  another  Rj  in  the 
same  group  of  judges,  a  multiple  comparison  test  is  performed.  This  test 
will  determine  the  numerical  significant  difference  between  the  Rj  * s . 4 


V.V.AV.' 


The  formula  is 


Ri  •  Rj  -> z 


k  (N)  {N  +  1) 


where 

=  R.  -  Rj  is  the  difference  between  any  two  Rj's. 

Z  =  d  (level  of  confidence) 

N  (N-l) 

k  =  number  of  judges 

N  =  number  of  items  being  ranked 

Using  the  sample  in  table  34  the  following  calculation  is  made 

<K-  .05  =  .004 

4  (3) 

.004  =  Z  value  of  2.65 

R-  -  Rj  >  2.65  (3)  (4)  (5) 

6 

R.  -  Rj  >  8.38 

The  Rj  for  the  example  would  have  to  differ  by  8.38  to  be  a  significant 
difference  at  the  confidence  value  of  p  =  .95.  Since  the  greatest  difference 
between  D  and  B  is  only  8,  one  would  conclude  that  there  is  not  a  significant 
di fference. 

If  the  confidence  level  had  been  p  =  .9,  then  the  significent  R.  -  R. 

'  J 

value  would  have  been  7.71  and  one  could  conclude  that  the  difference  between 
D  and  B  was  significant. 

In  the  calculations  for  determining  the  significance  of  R.  -  Rj,  a 
level  of  confidence  of«<v  =  .05  will  be  used. 
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MANHOURS  EXPENDED  ON  THE  PROJECT 
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Appendix  N 
Project  Costs 

One  goal  of  testing  the  methodology  to  assess  health  care  needs  is  to 
keep  costs  low.  The  method  should  not  cost  more  than  the  benefits  derived. 
While  costing  the  savings  of  the  method  is  difficult  the  manhours  required 
to  complete  the  methods  basic  steps  are  not.  Table  35  lists  the  basic  steps 
and  the  manhours  associated.  The  total  manhours  required  were  seventy-one, 
or  about  nine  days.  The  hours  are  not  concentrated  in  one  nine-day  period 
but  spread  out  over  the  course  of  about  ten  weeks.  Thus,  the  project 
should  not  require  an  individual  to  be  removed  from  his  or  her  regular 
duties. 

The  methodology  tested  required  some  concentrated  work  over  a  one  to 
two-day  period  and  did  require  daily  modified  nominal  group  sessions  for  a 
short  period.  However,  the  total  time  of  the  methodology  does  not  seem 
unreasonable  for  the  broad  base  of  data  received. 
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Table  35 

Cost  In  Manhours  of  Conducting  the  Project 

Project  Manhours 

Obtaining  mailing  lists 

Staff  1.5 

Active  duty  1.5 

Dependents  of  active  duty  2.0 

Retirees  &  their  dependents  2.5 

Commanders  .25 

Prepare  envelopes  wT th  letter  and  questionnaire  11.0 

Prepare  staff  questionnaires  2.5 

Record  results  of  questionnaires  4.5 

Evaluate  initial  results  3.5 

Prepare  second  survey  1 .0 

Prepare  envelopes  with  letters  and  questionnaires  11.0 

Conduct  fifteen  nominal  groups  10.0 

Record  second  questionnaireresul ts  1.5 

Evaluate  group  and  questionnaire  results  9.0 

Prepare  envelopes  with  inpatient  questionnaires  and  letters  5.0 

Record  results  of  inpatient  questionnaires!  2.0 

Evaluate  inpatient  data  .5 

Prepare  final  problem  list  1.5 


TOTAL  MANHOURS 


70.9  or  71  hours 


’  v'  O  V1 
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CLINIC  SURVEYOR  1  tiSTR'JCT J G?I3 

1.  Give  a  questionnaire  to  every  5th  patient.  (In  clinics  where  this  would 
not  use  up  the  questionnaires  allotec!,  then  distribute  them  every  2nd,  3rd,  or 
41 h  patient.)  Do  not  selectively  hand  them  out  or  skip  patients  who  would  be 
the  next  c no  to  receive  a  questionnaire  according  to  the  distribution  pattern. 


2.  Explain  to  the  patient  the  purpose  of  the  questionnaire.  (For  example, 
you  may  say  something  such  as:  "l.'e  are  taking  a  survey  to  find  out  how  our 
patients  feel  about  the  outpatient  medical  care  being  given.  Would  you  please 
fill  out  tin's  short  questionnaire  to  help  us  determine  how  to  improve  our 
services?" ) . 


3.  Maintain  a  positive  attitude  in  conducting  the  survey.  Encourage  patients 
to  take  time  to  answer  ajj_  questions  that  apply.  The  validity  of  the  survey 
may  only  be  realized  through  the  efforts  and  attitudes  of  those  personnel  who 
have  direct  contact  with  the  patient. 

4.  Show  the  patient  where  to  return  the  completed  questionnaire  and  pencil, 
and  ask  that  he  please  return  them  before  leaving  the  clinic. 

5.  If  the  patient  does  not  wish  to  fill  out  the  questionnaire,  mark  the  state¬ 
ment  "Prefer  riot  to  complete  this  questionnaire  at  this  time."  and  place  the 
form  with  the  completed  forms. 


G.  Till  out  the  following  information  after  all  the  allotted  questionnaires 
have  been  returned.  Place  any  comments/suggesticns  about  the  survey  on  the 
reverse  side.  This  form  will  be  sent  to  NSC  with  the  questionnaire. 

a. 

Time  started  giving  out  forms 

b. 

Number  of  forms  given  out 

(<r~ 

c. 

Sequence  that,  forms  were  given  out.  Every  _ 

patient. 

d. 

Actual  number  of  visitors  for  entire  day 

i 

1 

1 

i 

-a  i 

'  1 

1 

To  be-  f  i 

lied  out  by  Inc  test  controller. 

Ml  F  Code  09 

V 

CLINIC  NAME  fi/THC _ CLINIC  CODE  7  7 _ DATE  OF  SURVEY  /S  CT 8  / 


Estimated  number  of  clinic  visitors 


Number  of  questionnaires  given  to  clinic 
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